-- Logs begin at Wed 2022-06-15 21:24:34 UTC, end at Wed 2022-06-15 22:37:10 UTC. -- Jun 15 22:00:44.471589 dv-cinder-835384-7-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 15 22:00:44.480612 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 22:00:44 2022] *** Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: nodename: dv-cinder-835384-7-iscsi Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: machine: x86_64 Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: clock source: unix Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: pcre jit disabled Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: detected number of CPU cores: 4 Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: current working directory: / Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: detected binary path: /usr/bin/uwsgi-core Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: your processes number limit is 47680 Jun 15 22:00:44.482698 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: your memory page size is 4096 bytes Jun 15 22:00:44.483408 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: detected max file descriptor number: 2048 Jun 15 22:00:44.483408 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: lock engine: pthread robust mutexes Jun 15 22:00:44.483408 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: thunder lock: enabled Jun 15 22:00:44.483408 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 15 22:00:44.483408 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 22:00:44.526366 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: Python main interpreter initialized at 0x55b4001549c0 Jun 15 22:00:44.526366 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: python threads support enabled Jun 15 22:00:44.526366 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: your server socket listen backlog is limited to 100 connections Jun 15 22:00:44.526366 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: your mercy for graceful operations on workers is 90 seconds Jun 15 22:00:44.526719 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 22:00:44.526719 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: *** Operational MODE: preforking *** Jun 15 22:00:44.527009 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: *** uWSGI is running in multiple interpreter mode *** Jun 15 22:00:44.527009 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: spawned uWSGI master process (pid: 80286) Jun 15 22:00:44.527240 dv-cinder-835384-7-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 15 22:00:44.529897 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: spawned uWSGI worker 1 (pid: 80293, cores: 1) Jun 15 22:00:44.529897 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: spawned uWSGI worker 2 (pid: 80294, cores: 1) Jun 15 22:00:44.529897 dv-cinder-835384-7-iscsi devstack@keystone.service[80286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 22:00:50.054046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:00:50.054046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: from cryptography.utils import int_from_bytes Jun 15 22:00:50.054887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:00:50.054887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: from cryptography.utils import int_from_bytes Jun 15 22:00:50.055241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:00:50.055241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: from cryptography.utils import int_from_bytes Jun 15 22:00:50.055732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 22:00:50.055732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: from cryptography.utils import int_from_bytes Jun 15 22:00:50.104965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 22:00:50.105193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 22:00:50.105275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] command line args: [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 22:00:50.105582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 22:00:50.105712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ================================================================================ {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 22:00:50.106007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] admin_token = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.106137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 22:00:50.106220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] config_dir = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.106286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 22:00:50.106435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.106575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] command line args: [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 22:00:50.106663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] config_source = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.106737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 22:00:50.106811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] debug = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.106889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ================================================================================ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 22:00:50.106963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] admin_token = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] config_dir = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] config_source = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] debug = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.107929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_config_append = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_dir = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_file = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.108896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_config_append = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_dir = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.109964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.110948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.111942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.112180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.112369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.112457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.112612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.112851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.112942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] publish_errors = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.113982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] standard_threads = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] publish_errors = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.114939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] use_journal = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] use_json = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] use_stderr = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] use_syslog = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] standard_threads = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.115952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.116132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.116213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.116343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.116424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.116517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] use_journal = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.116617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.116692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] use_json = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.116847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] use_stderr = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.116932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.117022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] use_syslog = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.117097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.117248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 22:00:50.117344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.117535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.117628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.117770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.117847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118732 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.118972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.119997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.120951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.121933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.122846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.123942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.124962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.125906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.126900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.127147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.127393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.127467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.127628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.127868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.127970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.128898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.129761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.129848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.129928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.129990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.130949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.131983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.132997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.133964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.134961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.135968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.136970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.137971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138882 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.138991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.139876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.140096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.140207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.140316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.140541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.140786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.141019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.141238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.141476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.230059 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.external = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.password = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] auth.token = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.232801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.234880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.external = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.235974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.236380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.password = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] auth.token = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.237779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.238979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.239970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.240948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.241900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.242859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.243993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.244948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.245947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.246966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.247923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.248991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.249977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.250948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.251720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.252009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.252089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.252270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.252522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.252761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.252838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.253995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.254959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.255980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.256931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.257891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.258985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.259942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.260962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.261917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.262884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.263989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] role.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.264936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] role.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.265923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.266942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.267100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.267179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.267329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.267438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.267630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.267880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.268983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.269977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] role.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.270933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] role.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.271905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.272873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273375 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.273854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.274924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.275991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.276955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.277929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.connection = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.278927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.279972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.280940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.281933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.282074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.282153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.282307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.282385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.282495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 22:00:50.282584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.282786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.283038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.283877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.284184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.284448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.284696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.284946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.285186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.285455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.285693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.285935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.286174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.286410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.286653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.286888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.287130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.287365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.287610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.287843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.288085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.288312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.288907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.289144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 22:00:50.289312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 22:00:50.313220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.313417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.313651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.315208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.315441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.315667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.322783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.324375 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.351304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.351575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.353437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.353672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.405347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.406067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.461013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.461277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.461399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.461473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.530556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.530762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.530919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.531894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.532099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.532295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.555962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.556946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.557008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.557211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.557383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.557459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.568937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.569083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.582923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.583757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 22:00:50.600898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.601161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 22:00:50.601658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.601810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.601905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 22:00:50.601990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 22:00:50.602067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.602248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.602374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.602455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 22:00:50.602579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.602858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.602983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.603128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.603371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.603640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.613703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.613982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.614254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.614529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.614947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.615199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.615481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.615759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.622767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.623803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.626075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.626360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.626640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.627048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.627350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.627697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.627821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.628011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.628873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.629018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.629144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.629366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.629665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.629913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.630177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.630434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.655592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.657158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.657285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.657504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.659307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.659583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.662878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.663157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.663433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.665161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.665455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.665731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.671227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.671506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.673032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.673310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.676023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.676300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.676581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.676859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.677138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.677417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.677686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.677949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.678346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.678609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.678889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.679165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.679435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.679704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.679966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.680236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.696703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.696976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.699288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.699558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.701584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.704042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.705417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.705708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.708177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.708469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.710845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.713527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.714657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.717054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.718308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.718605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.718889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.719174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.719447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.719727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.721214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.721546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.721850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.722087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.722381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.722637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.740480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.740741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.741032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.741298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.743582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.743865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.744125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.744354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.749198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.750941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.752811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.754519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.754610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.754807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.754933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.755095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.755399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.755676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.757814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.758088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.758493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.758778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.759049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.769276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.769584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.769875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.770153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.770438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.770704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.770964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.773263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.773589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.773865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.774135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.774390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.774653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.774915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.789586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.792879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.794483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.796211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.797793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.797919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.799655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.799938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.800233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.801559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.803147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.804915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.805189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.805492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.807482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.809091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.812672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.812817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.813010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.813294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.813596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.814290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.818208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.818493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.818771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.819108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.822885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.823172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.823455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.828298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.828585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.828860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.831473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.831760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.832039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.832312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.832572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.832876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.833152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.833453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.833827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.834096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.834368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.834626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.834890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.835150 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.837194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 22:00:50.837495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.837763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.838030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.838294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.838572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.838836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.839101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.839368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.839728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.840002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.840270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.840529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.840777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 22:00:50.872949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b4001549c0 pid: 80294 (default app) Jun 15 22:00:50.876503 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40af9f-317f-4b6d-b701-66c3acd1d65c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:00:50.876871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40af9f-317f-4b6d-b701-66c3acd1d65c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:00:50.877184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40af9f-317f-4b6d-b701-66c3acd1d65c None None] PATH_INFO: `/v3` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:00:50.879648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b4001549c0 pid: 80293 (default app) Jun 15 22:00:50.881514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Wed Jun 15 22:00:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:00:58.969860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:00:58.970479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:00:58.970589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:00:58.975802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:00:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:00:58.982122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:00:58.982647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:00:58.982812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:00:59.056000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: INFO dbcounter [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] Registered counter for database keystone Jun 15 22:00:59.078756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG oslo_db.sqlalchemy.engines [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:00:59.086086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writer thread running {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:00:59.272903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG passlib.handlers.bcrypt [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80294) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 22:00:59.273312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG passlib.handlers.bcrypt [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80294) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 22:00:59.330952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:00:59.332770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:00:59.473224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:00:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 15 22:00:59.662568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:00:59.740813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: INFO dbcounter [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] Registered counter for database keystone Jun 15 22:00:59.763085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG oslo_db.sqlalchemy.engines [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 22:00:59.770681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writer thread running {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 22:00:59.907892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f9bdf-7c2f-411e-adbd-4b71330ed808 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:00:59.914565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:00:59.915351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:00:59.915704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:00:59.916031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:00:59.927338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:00:59.985490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING keystone.common.rbac_enforcer.enforcer [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 22:00:59.986253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e14276-7fb5-497a-9013-a80f935a1f4b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:00:59.998031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jun 15 22:00:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:01:00.005011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:00.024617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768b036-f3b8-46cd-8096-c6822eb8ee48 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:00.029872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:00.031076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:00.031362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:00.031643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] PATH_INFO: `/v3/projects/adfb054cdc38413f9503cf43dad1c55e` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:00.033680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] RBAC: Authorizing `identity:get_project(project_id=adfb054cdc38413f9503cf43dad1c55e)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:00.084175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 22:01:00.084515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dbc2e-2f05-4c93-ad1a-3d145f1c9c0e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:00.089441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Wed Jun 15 22:01:00 2022] GET /identity/v3/projects/adfb054cdc38413f9503cf43dad1c55e => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:02.334005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa53d-c23f-49aa-a42c-2d64448a3fc2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:02.334589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa53d-c23f-49aa-a42c-2d64448a3fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:02.334589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa53d-c23f-49aa-a42c-2d64448a3fc2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:02.338902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:02.345077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:02.345637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:02.345637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:02.367077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:02.368706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:02.379085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 22:01:02.402626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fa53d-c23f-49aa-a42c-2d64448a3fc2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:02.418321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fa53d-c23f-49aa-a42c-2d64448a3fc2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:02.423297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e98d4-befa-48b7-ae45-bb6e8f1d9c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:02.424591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e98d4-befa-48b7-ae45-bb6e8f1d9c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:02.424874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e98d4-befa-48b7-ae45-bb6e8f1d9c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:02.425149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e98d4-befa-48b7-ae45-bb6e8f1d9c79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:02.434294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e98d4-befa-48b7-ae45-bb6e8f1d9c79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:02.436106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e98d4-befa-48b7-ae45-bb6e8f1d9c79 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:02.446377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jun 15 22:01:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:01:02.452255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:02.462327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238176e1-3e59-44a9-b2ac-118369b56acc None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:02.468184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7520a1-676a-4a8f-9d83-5468e8e0bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:02.469090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7520a1-676a-4a8f-9d83-5468e8e0bf4d admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:02.469371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7520a1-676a-4a8f-9d83-5468e8e0bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:02.469664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7520a1-676a-4a8f-9d83-5468e8e0bf4d admin admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:02.471378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7520a1-676a-4a8f-9d83-5468e8e0bf4d admin admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:02.473263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7520a1-676a-4a8f-9d83-5468e8e0bf4d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:02.474971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Wed Jun 15 22:01:02 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:04.725908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0a20-e711-4f4e-8d24-47d1c13b9844 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:04.726551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0a20-e711-4f4e-8d24-47d1c13b9844 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:04.726551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0a20-e711-4f4e-8d24-47d1c13b9844 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:04.727853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:04.733995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:04.734547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:04.734547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:04.757423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:04.757835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:04.776929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41b52-6bbb-48e7-a5f2-17baca2bed97 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:04.777211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41b52-6bbb-48e7-a5f2-17baca2bed97 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:04.777620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a41b52-6bbb-48e7-a5f2-17baca2bed97 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:04.780439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 6/11] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:04.789192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:04.789192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:04.791070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:04.838355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG passlib.handlers.bcrypt [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80293) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 22:01:04.838904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG passlib.handlers.bcrypt [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80293) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 22:01:04.857291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 6/12] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:04.880427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:04.887071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:04.888739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:04.906401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.012226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:05.013670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1eb05-d99e-4f6a-82f1-9e6b011dbb74 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.036285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.056682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.057392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.057677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.057956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.150042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:05.152702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:05.158389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126a2d-5647-4103-9a61-1086cef3c1a7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.160958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.186375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.202760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.203871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.204161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.204443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.218136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:05.230775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:05.231847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:05.232662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 8/14] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:05.239436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.292262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 7/15] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:01:05.309893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.368533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e756bab-0308-49b8-8186-4dc299360a7b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.406362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.407219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.407552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.407879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.408967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:05.409275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:05.410798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:05.423994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61fce9-f54a-4fce-a11b-1969ce9d616b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.427079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 9/16] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:05.433383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.451228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.464929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.465773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.466051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.466302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.469868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.478218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:05.479711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:01:05.501591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:05.503254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:05.504275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:01:05.504275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:01:05.504275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:01:05.504275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:05.504275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 8/17] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:05.509657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.568929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147180e9-d7b7-497f-b514-09b191cece6f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.612941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.613888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.614179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.620527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.622705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:05.624555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:05.626691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:05.631884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf685d-149c-4380-b0df-d0661d5709e6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.632947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.676289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.677314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.677693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.678142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.679198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:05.679553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:05.681131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:05.700843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:05.758859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.768838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb03c18-81bb-4b10-a113-b13bd3d3a459 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:05.811824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e379b2-ecf5-4e14-9a0e-93b3f4d4736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:05.812646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e379b2-ecf5-4e14-9a0e-93b3f4d4736e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:05.812942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e379b2-ecf5-4e14-9a0e-93b3f4d4736e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:05.813205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e379b2-ecf5-4e14-9a0e-93b3f4d4736e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:05.814949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e379b2-ecf5-4e14-9a0e-93b3f4d4736e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:05.816730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e379b2-ecf5-4e14-9a0e-93b3f4d4736e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:05.818547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 11/20] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:05.825099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:05.872783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:05.952971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254381-3cab-4c72-a9fd-b726adc17147 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:06.003886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:06.004868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:06.005303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:06.005769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:06.006639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.domain.id=default, user.id=2163e83cb8fa4cdb98d8294e2a7f2e22) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:06.006952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:06.008479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81c509-735c-4e43-984e-6c571f8d1a3b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:06.019629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 10/21] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jun 15 22:01:05 2022] GET /identity/v3/role_assignments?user.id=2163e83cb8fa4cdb98d8294e2a7f2e22&scope.domain.id=default&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 233 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:08.203639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e7c7-1b24-430b-be9c-eea7a0176a8a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:08.204262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e7c7-1b24-430b-be9c-eea7a0176a8a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:08.204508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e7c7-1b24-430b-be9c-eea7a0176a8a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:08.206312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 12/22] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:08.215017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85411d3-2271-473e-b479-29734bd62c84 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:08.215491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85411d3-2271-473e-b479-29734bd62c84 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:08.215595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85411d3-2271-473e-b479-29734bd62c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:08.242578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e85411d3-2271-473e-b479-29734bd62c84 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:08.243864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e85411d3-2271-473e-b479-29734bd62c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:08.348241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 11/23] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:08.382545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0e7c7-1b24-430b-be9c-eea7a0176a8a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:08.521750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0e7c7-1b24-430b-be9c-eea7a0176a8a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:08.574051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279e51-3a73-4331-a18a-a374df4e2b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:08.575290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279e51-3a73-4331-a18a-a374df4e2b53 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:08.575657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279e51-3a73-4331-a18a-a374df4e2b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:08.575941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279e51-3a73-4331-a18a-a374df4e2b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:08.576729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe279e51-3a73-4331-a18a-a374df4e2b53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:08.578183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe279e51-3a73-4331-a18a-a374df4e2b53 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:08.736680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 13/24] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 15 22:01:08 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:08.769731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e086799-5879-46ea-aa50-30a89d9faf6f None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:08.770073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e086799-5879-46ea-aa50-30a89d9faf6f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:08.770305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e086799-5879-46ea-aa50-30a89d9faf6f None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:08.771717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 12/25] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:08.778001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:08.778281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:08.778486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:08.805805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:08.807418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:08.834810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:08.913706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 14/26] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:08.948907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e086799-5879-46ea-aa50-30a89d9faf6f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:08.988396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:09.129015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e086799-5879-46ea-aa50-30a89d9faf6f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:09.217699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:09.218848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.219357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.219994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.242858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:09.244482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-7f340964-86a2-43e5-88a8-df93edb9c0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:01:09.277281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:09.278187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:09.278952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:01:09.278952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:01:09.278952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:01:09.278952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:09.278952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 13/27] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:09.285374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:09.354245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c94cb3-0a43-45af-b999-88b3d186ebd9 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.354595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c94cb3-0a43-45af-b999-88b3d186ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.354799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c94cb3-0a43-45af-b999-88b3d186ebd9 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.356301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 14/28] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:09.362522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353273-98e4-4c9c-b6fb-411552ed5b23 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.362812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353273-98e4-4c9c-b6fb-411552ed5b23 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.363079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0353273-98e4-4c9c-b6fb-411552ed5b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.389916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a0353273-98e4-4c9c-b6fb-411552ed5b23 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:09.393137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a0353273-98e4-4c9c-b6fb-411552ed5b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:09.426412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48536c18-3f41-4764-ab8b-779fcda10457 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:09.490836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:09.491533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.491814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.492086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.492844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:09.493154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:09.496094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:09.525494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 15/29] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:09.526597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 15/30] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:09.526922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc3e7-ac38-4fca-8edf-65f4b2e8f35e None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.527212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc3e7-ac38-4fca-8edf-65f4b2e8f35e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.527545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bc3e7-ac38-4fca-8edf-65f4b2e8f35e None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.529123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 16/31] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:09.535448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:09.551228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.551577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.551796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.568688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:09.571163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:09.572491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:09.576226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:09.656392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 17/32] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:09.657636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:09.708999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7a12f-5382-4e94-b68e-7da162de086e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:09.757746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a8608-ac71-4a2d-8128-fdc3f2fa4a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:09.758495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a8608-ac71-4a2d-8128-fdc3f2fa4a72 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.758729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a8608-ac71-4a2d-8128-fdc3f2fa4a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.759006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a8608-ac71-4a2d-8128-fdc3f2fa4a72 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.759787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a8608-ac71-4a2d-8128-fdc3f2fa4a72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:09.761283 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a8608-ac71-4a2d-8128-fdc3f2fa4a72 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:09.801056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50641d63-66e3-4a57-ab08-2eb6948a9b91 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:09.806214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 16/33] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:01:09 2022] POST /identity/v3/projects => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:09.819030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175ef6f-3fa2-4674-98b2-84d70a44393e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.819271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175ef6f-3fa2-4674-98b2-84d70a44393e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.819588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175ef6f-3fa2-4674-98b2-84d70a44393e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.821384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 17/34] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:09 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:09.821674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175ef6f-3fa2-4674-98b2-84d70a44393e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:09.866641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ece8b2-dc3f-497f-aa7e-b3764918bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:09.868302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ece8b2-dc3f-497f-aa7e-b3764918bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.868708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ece8b2-dc3f-497f-aa7e-b3764918bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.869600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ece8b2-dc3f-497f-aa7e-b3764918bc35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.884804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:09.890678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ece8b2-dc3f-497f-aa7e-b3764918bc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b2ece8b2-dc3f-497f-aa7e-b3764918bc35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:09.906558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:09.907663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:09.909027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:09.911218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 18/35] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:09.912642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:09.913012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:09.913768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:09.934957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:09.950902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:09.953600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:10.000252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175ef6f-3fa2-4674-98b2-84d70a44393e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.068163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.068883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.069158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.070338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.070338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.070603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 19/36] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:10.072158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.073915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.101544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 15 22:01:09 2022] POST /identity/v3/roles => generated 223 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:10.109615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.258651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06ac88-9539-4b6e-a743-cca06819b2a7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.305262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:10.309534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.310251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.310585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.310872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.311768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:10.312088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.314260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.331551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:10.337633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.421859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585f3f7-a7d8-4062-8018-1f329b0df1c2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.460666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:10.474415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a878839-38ff-44c9-ba5e-3bd847a8d878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.475106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a878839-38ff-44c9-ba5e-3bd847a8d878 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.475397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a878839-38ff-44c9-ba5e-3bd847a8d878 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.475677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a878839-38ff-44c9-ba5e-3bd847a8d878 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.476453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a878839-38ff-44c9-ba5e-3bd847a8d878 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.477904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a878839-38ff-44c9-ba5e-3bd847a8d878 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.483235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134667-619e-4e9d-a1bd-a30ab8746bfd None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.491117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 15 22:01:10 2022] POST /identity/v3/roles => generated 225 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:10.492194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef3daa-8fa9-497f-b9be-02ca6adf429a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.492487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef3daa-8fa9-497f-b9be-02ca6adf429a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.492784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef3daa-8fa9-497f-b9be-02ca6adf429a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.494583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 20/40] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:10.500455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.500763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.501042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.520234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:10.521698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:10.530173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.531233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.531515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.531825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.533427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.534980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.536932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 21/41] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:10 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:10.543039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.611276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 21/42] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:10.617263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:10.635699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.668684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168658f-d40d-4535-8ce6-fcac77b3fd25 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.712361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.713180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.713500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.713779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.714987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.716491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.718496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:10.724965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.750813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fa48c-2ff6-4dd4-8c03-5737762b5800 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.765551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:10.789648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.790480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.790760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.791035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.792283 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.793825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.795571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 22/44] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:10.802391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:10.917678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327ff4b-16d7-48db-bad1-2dcdc1198302 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.945594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a389d-f133-4f29-87f1-a1d4a87c35d1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:10.956286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a790ef7-3af5-40af-bc6f-ad8a70df0477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.956888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a790ef7-3af5-40af-bc6f-ad8a70df0477 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.957140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a790ef7-3af5-40af-bc6f-ad8a70df0477 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.957448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a790ef7-3af5-40af-bc6f-ad8a70df0477 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.958168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a790ef7-3af5-40af-bc6f-ad8a70df0477 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.959634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a790ef7-3af5-40af-bc6f-ad8a70df0477 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:10.972212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:10.981709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6594af-fdeb-48c8-bfe0-1eac4b71b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:10.982612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6594af-fdeb-48c8-bfe0-1eac4b71b04a None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:10.982900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6594af-fdeb-48c8-bfe0-1eac4b71b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:10.983182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6594af-fdeb-48c8-bfe0-1eac4b71b04a None admin] PATH_INFO: `/v3/domains/default/users/2163e83cb8fa4cdb98d8294e2a7f2e22/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:10.985231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6594af-fdeb-48c8-bfe0-1eac4b71b04a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2163e83cb8fa4cdb98d8294e2a7f2e22, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:10.986310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 23/45] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:01:10 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:01:10.986961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6594af-fdeb-48c8-bfe0-1eac4b71b04a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:11.107428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 23/46] 10.222.0.55 () {58 vars in 1361 bytes} [Wed Jun 15 22:01:10 2022] PUT /identity/v3/domains/default/users/2163e83cb8fa4cdb98d8294e2a7f2e22/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:01:13.155430 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33adfd5-e68c-4677-a72f-41b42c84110b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.156046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33adfd5-e68c-4677-a72f-41b42c84110b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.156046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33adfd5-e68c-4677-a72f-41b42c84110b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.157676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 24/47] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:13.165200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.165774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.165774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.186142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:13.187735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:13.233515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33c01-9df4-4c22-9815-db5cc5ad5394 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.233827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33c01-9df4-4c22-9815-db5cc5ad5394 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.234089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33c01-9df4-4c22-9815-db5cc5ad5394 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.236575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 25/48] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:13.242754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.243047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.243331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.262437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:13.263724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:13.265388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 24/49] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:13.289570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:13.295610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:13.341807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 26/50] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:13.365562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:13.397622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead292b-eea8-42fb-a6cd-83ded916291e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:13.416964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:13.435819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:13.436645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.436933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.437216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.438630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:13.440555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:13.444948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 25/51] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:13.451027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:13.473557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcb322-84f1-452f-a1c1-a2778b5d6f60 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:13.509942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:13.510757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.511042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.511315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.522880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:13.530585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:13.531440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:13.532175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 27/52] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:13.538551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:13.558532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9429dd5-93a0-4266-9ab2-c4e6f86992b2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:13.565524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:13.594358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:13.595049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.595340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.595617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.596334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:13.597849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:13.627070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 26/53] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jun 15 22:01:13 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:01:13.646254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ea4c0-36c4-4af5-bcb0-de8db948548b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:13.688608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:13.689220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.689540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.689821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.690644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:13.690957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:13.692418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:13.702620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 28/54] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:13.708772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:13.751638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:13.821803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd5d27-3ce4-46f1-963e-dfa6bfd8c43c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:13.856562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:13.857481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:13.857761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:13.858032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:13.859252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:13.860803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:13.862498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:13 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:13.868307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:13.962108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:13.978753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21b356-b213-49a6-859f-a6228542028e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:14.015308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf0ef8-9495-4aa4-824e-a28d39aeffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:14.016107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf0ef8-9495-4aa4-824e-a28d39aeffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:14.016385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf0ef8-9495-4aa4-824e-a28d39aeffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:14.016640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf0ef8-9495-4aa4-824e-a28d39aeffb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:14.018200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf0ef8-9495-4aa4-824e-a28d39aeffb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:14.019717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf0ef8-9495-4aa4-824e-a28d39aeffb1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:14.021423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 29/56] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:14.027450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:14.131813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb33803-b2a1-4f7d-ac81-92c0b3a491da None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:14.139560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:14.168717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:14.169526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:14.169809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:14.170087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:14.170930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.domain.id=default, user.id=2163e83cb8fa4cdb98d8294e2a7f2e22) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:14.171246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:14.172723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e19f7d-ecfb-43fd-be98-ecbfeaba2278 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:14.179119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jun 15 22:01:14 2022] GET /identity/v3/role_assignments?user.id=2163e83cb8fa4cdb98d8294e2a7f2e22&scope.domain.id=default&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:15.799012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51ce2b-d6f4-4517-8be2-df185aab15a8 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:15.799590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51ce2b-d6f4-4517-8be2-df185aab15a8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:15.799590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51ce2b-d6f4-4517-8be2-df185aab15a8 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:15.800971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 30/58] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:15.806478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:15.806892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:15.807050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:15.824934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:15.826166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:15.897961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 29/59] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:15.923447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51ce2b-d6f4-4517-8be2-df185aab15a8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:16.030551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51ce2b-d6f4-4517-8be2-df185aab15a8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:16.066351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee207-79ca-4025-bd7d-2fbf60640ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:16.067080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee207-79ca-4025-bd7d-2fbf60640ffd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:16.067360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee207-79ca-4025-bd7d-2fbf60640ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:16.067633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee207-79ca-4025-bd7d-2fbf60640ffd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:16.068897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bee207-79ca-4025-bd7d-2fbf60640ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:16.070372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bee207-79ca-4025-bd7d-2fbf60640ffd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:16.072015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 31/60] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:16.077895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:16.183114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:16.186494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e7500-e205-498f-9718-e9b0b4f7a23b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:16.224216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f6287-7d91-42c2-aab4-bacfdef276dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:16.224903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f6287-7d91-42c2-aab4-bacfdef276dd None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:16.225189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f6287-7d91-42c2-aab4-bacfdef276dd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:16.225501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f6287-7d91-42c2-aab4-bacfdef276dd None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:16.226220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f6287-7d91-42c2-aab4-bacfdef276dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:16.227694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f6287-7d91-42c2-aab4-bacfdef276dd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:16.254902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 30/61] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:16 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:19.555875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c6c2-c0af-4ab2-983f-80ef32e049f1 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.556870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c6c2-c0af-4ab2-983f-80ef32e049f1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.557388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c6c2-c0af-4ab2-983f-80ef32e049f1 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.559015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 32/62] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:19.564800 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.565714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.566221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.593557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:19.595239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:19.684183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236111a3-d281-4156-b3f2-f5ae20f812be None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.684503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236111a3-d281-4156-b3f2-f5ae20f812be None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.684745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236111a3-d281-4156-b3f2-f5ae20f812be None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.686160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 33/63] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:19.691402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8700-09dc-4bf3-9bd8-5cbae5fa57f6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.691725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8700-09dc-4bf3-9bd8-5cbae5fa57f6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.691972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8700-09dc-4bf3-9bd8-5cbae5fa57f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.707197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 31/64] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:19.717257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-81eb8700-09dc-4bf3-9bd8-5cbae5fa57f6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:19.718508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-81eb8700-09dc-4bf3-9bd8-5cbae5fa57f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:19.737832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:19.744828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:19.838484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 34/65] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:19.840527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6df5f-2231-4e8a-a6bc-f24c9cea5b5e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.841205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6df5f-2231-4e8a-a6bc-f24c9cea5b5e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.841727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6df5f-2231-4e8a-a6bc-f24c9cea5b5e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.843506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 35/66] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:19.850715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dadfb-b6b6-4ee9-9b8b-544fb7949d7e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.851342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dadfb-b6b6-4ee9-9b8b-544fb7949d7e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.851855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dadfb-b6b6-4ee9-9b8b-544fb7949d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.872906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:19.882630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2e7dadfb-b6b6-4ee9-9b8b-544fb7949d7e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:19.883962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2e7dadfb-b6b6-4ee9-9b8b-544fb7949d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:19.890962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ab7dc-f533-40a6-af94-e17abb423b87 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:19.931448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:19.932297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.932584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.932865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.945826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:19.953789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:19.955045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 32/67] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:19.956000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:19.973311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 36/68] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:19.974992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde91937-b194-4fa8-889c-448e80de0b1c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:19.975350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde91937-b194-4fa8-889c-448e80de0b1c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:19.975691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde91937-b194-4fa8-889c-448e80de0b1c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:19.977348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 37/69] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:19.982191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde91937-b194-4fa8-889c-448e80de0b1c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.083500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676d08-9f78-4dc2-9f1c-80e4f2703c80 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.086981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.110942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde91937-b194-4fa8-889c-448e80de0b1c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.119272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0e80-05e4-42a3-a9f5-28273114cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.120113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0e80-05e4-42a3-a9f5-28273114cf37 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.120396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0e80-05e4-42a3-a9f5-28273114cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.120681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0e80-05e4-42a3-a9f5-28273114cf37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.131694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0e80-05e4-42a3-a9f5-28273114cf37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-9d6d0e80-05e4-42a3-a9f5-28273114cf37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:20.139415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:20.140274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:20.141020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 33/70] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:20.142053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.142213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.142493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.154103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.156925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.158033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.158492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.158946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.159787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:20.160070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:20.160168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.161458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:20.161574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:20.171657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 38/71] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:20.176900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.240211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 34/72] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:20.242499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.291515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b61e0-ca29-499d-9835-c37cb5cb7830 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.324920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.325810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.326096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.326373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.337069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:20.345204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:20.346348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:20.347132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 39/73] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:20.347729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.355587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.366374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e2e0f-7191-4408-9e25-aec42b0eea14 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.405179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.405923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.406208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.406549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.407272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:20.407669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.409184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:20.412395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.424530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 35/74] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:20.424530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.473269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d22f3b-edb1-4aad-beef-d4a31488b170 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.507018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.507915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.508200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.508479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.524251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.525763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:20.527507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 40/75] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:20.531069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.537372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6dbc4-1884-449f-805d-a749c7705822 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.573587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.574404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.574693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.574971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.585586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:20.589762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:20.593651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:20.594492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:20.595332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 36/76] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:20.596104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.633288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b29abb-49fe-47d6-9460-6797896a1273 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.658538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.675014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.675699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.675985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.676261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.677036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:20.677414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.678797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52d80a-5f91-4c4c-9a53-12d0bdc3435f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:20.687313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 41/77] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:20.693527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963c37-c0f3-4b89-8804-2d1f52c2deaa None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.693827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963c37-c0f3-4b89-8804-2d1f52c2deaa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.694135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25963c37-c0f3-4b89-8804-2d1f52c2deaa None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.695438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 42/78] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:20.696149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25963c37-c0f3-4b89-8804-2d1f52c2deaa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.704145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839efc04-a29d-4a85-a751-7e9a07588cbf None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.739427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.740605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.740869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.742231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.743718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:20.745428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 37/79] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:20.746205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.802116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25963c37-c0f3-4b89-8804-2d1f52c2deaa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.827657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.839840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8dfdb-9b9b-4a0c-afa3-f16649732827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.840510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8dfdb-9b9b-4a0c-afa3-f16649732827 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.840790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8dfdb-9b9b-4a0c-afa3-f16649732827 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.841074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8dfdb-9b9b-4a0c-afa3-f16649732827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.849192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c18a6a-c7ea-4b54-afb8-3efc9b62e89d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:20.874814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:20.884593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:20.885209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:20.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:20.885808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:20.886588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:20.886899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.888292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:20.897069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 38/80] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:20.897934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:20.918478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8dfdb-9b9b-4a0c-afa3-f16649732827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:20.920030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8dfdb-9b9b-4a0c-afa3-f16649732827 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.007525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2961ef-5304-4715-8b1f-34a510dd22bb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.028806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 43/81] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:21.028806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.028806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.028806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.046404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.047307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.047404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:21.047596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.047873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.048681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:21.049269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.050847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.052502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 39/82] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:20 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:21.053293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.066317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.112980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.117829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 44/83] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:21.118858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.162038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace6a54-9b7c-4ca8-b2dc-ebb2662bd0cc None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.197121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.197831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.198117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.198400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.219474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f267706-33e2-4178-acb1-cdbc75cd0de9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.255730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.256646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.256928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.257200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.258555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.260055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.262009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 45/84] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:21.262978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.274359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.275892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.288868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.332207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.368392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0213e46-82e8-462c-9709-416cdd81d5f1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.378760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 40/85] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:21.379632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.409342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e7343-6243-452b-8783-b9be50604493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.410216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7343-6243-452b-8783-b9be50604493 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.410500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7343-6243-452b-8783-b9be50604493 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.410779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7343-6243-452b-8783-b9be50604493 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.411997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e7343-6243-452b-8783-b9be50604493 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.413926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e7343-6243-452b-8783-b9be50604493 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.415615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 46/86] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:21.416398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e7343-6243-452b-8783-b9be50604493 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.483744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378098-d801-4d7d-bbc0-7d5c3591bc0a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.513587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.521949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.522622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.522906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.523186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.524269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e7343-6243-452b-8783-b9be50604493 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.549011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.561057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.562126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.562416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.562694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.563966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.565560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.567233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 47/87] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:21.568011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.601294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.602852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.668990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64174-a943-48c8-9ccd-93adeacd1dba None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.703058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 41/88] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:21.703923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.704592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.705260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.705558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.705836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.734670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.762343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.776453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.778009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.807604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c8b2-ab81-4666-9ac2-81ba82f2d693 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.842235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.843122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:21.843433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:21.843710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:21.844894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:21.846557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:21.848314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 42/89] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:21.849091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.887489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 48/90] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:21.887489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:21.938340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.963265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38512466-5f84-4505-bdbb-42548003ba68 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.980834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277b910-c8d9-468e-9f3d-47d02a5b43d1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:21.987667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:21.999247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:21.999950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.000210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.000487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.001456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=027a7e4e27d9446295cfe7447b23dd7b) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:22.001948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.003457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.009559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 43/91] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:21 2022] GET /identity/v3/role_assignments?user.id=027a7e4e27d9446295cfe7447b23dd7b&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:22.010366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:22.019876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:22.020606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.020888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.021171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.021998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.023583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.058473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 49/92] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:21 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:22.059829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:22.154793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c682e9-066c-425b-80d6-a57768fcce82 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:22.209281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c414d-013d-4dd0-a56b-a7f443e33a66 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:22.212061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:22.212061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.212282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.212571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.218420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.218420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.218420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 44/93] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:22 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:22.218420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:22.239778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:22.267389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:22.268195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.268478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.269799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.271783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=2163e83cb8fa4cdb98d8294e2a7f2e22) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:22.272107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.273638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.285812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 50/94] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:22 2022] GET /identity/v3/role_assignments?user.id=2163e83cb8fa4cdb98d8294e2a7f2e22&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:22.286529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:22.329984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:22.372735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f094977-da40-4b0b-a94e-2d2e3d381260 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:22.416345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:22.417754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.418383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.418884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] PATH_INFO: `/v3/projects/724488c7cb0a40da8223d9289c766774` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.420468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] RBAC: Authorizing `identity:get_project(project_id=724488c7cb0a40da8223d9289c766774)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.422449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.424576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 45/95] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:22 2022] GET /identity/v3/projects/724488c7cb0a40da8223d9289c766774 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:22.426796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81135b22-288d-43a3-9f58-2290ee65882d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:22.431140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:22.490709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:22.491761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.492277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.492561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.493452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] RBAC: Adding query filter params (role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=027a7e4e27d9446295cfe7447b23dd7b) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:22.493772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.495292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9f14c-4070-453e-aa70-e0ba1d96b151 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.504027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 51/96] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:22 2022] GET /identity/v3/role_assignments?user.id=027a7e4e27d9446295cfe7447b23dd7b&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:22.579630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df675-dcc1-48b2-82ee-20b2b68b6469 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:22.612119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:22.625509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:22.626255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:22.626552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:22.626840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:22.627741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=724488c7cb0a40da8223d9289c766774, user.id=027a7e4e27d9446295cfe7447b23dd7b) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:22.628075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:22.629859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b48fc-ed86-4228-b273-8c513ad017cd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:22.636722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 46/97] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:22 2022] GET /identity/v3/role_assignments?user.id=027a7e4e27d9446295cfe7447b23dd7b&scope.project.id=724488c7cb0a40da8223d9289c766774&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:25.167479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e168ae-c00c-4c37-9e7d-1315d6c53d5e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.168101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e168ae-c00c-4c37-9e7d-1315d6c53d5e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.168101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e168ae-c00c-4c37-9e7d-1315d6c53d5e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.169681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 52/98] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:25.176245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.176790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.176869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.198433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:25.199697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:25.260666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5870f7-a1fb-4127-b9fc-a9ad0b130c8f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.260951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5870f7-a1fb-4127-b9fc-a9ad0b130c8f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.261506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5870f7-a1fb-4127-b9fc-a9ad0b130c8f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.263111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 53/99] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:25.276850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.277566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.278046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.307852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 47/100] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:25.315025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:25.316531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:25.342461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:25.387409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:25.459969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 54/101] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:25.500610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:25.550831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f374b74-76e3-4411-839a-6a8283f65ea8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:25.592874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:25.632352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49fc53-1344-48a2-896b-9685c089b8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:25.633193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49fc53-1344-48a2-896b-9685c089b8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.633505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49fc53-1344-48a2-896b-9685c089b8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.633781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49fc53-1344-48a2-896b-9685c089b8b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.651159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49fc53-1344-48a2-896b-9685c089b8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5d49fc53-1344-48a2-896b-9685c089b8b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:25.660653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:25.661631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:25.662395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:25.665184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 48/102] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:25.666689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dca87-2dc7-47a1-8cb6-b108fab9759d None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.667186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dca87-2dc7-47a1-8cb6-b108fab9759d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.667656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dca87-2dc7-47a1-8cb6-b108fab9759d None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.669451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 49/103] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:25.670945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84eb94-e126-4f2e-9210-a3a5e2b95188 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.671435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84eb94-e126-4f2e-9210-a3a5e2b95188 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.671916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84eb94-e126-4f2e-9210-a3a5e2b95188 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.674174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 50/104] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:25.677376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84eb94-e126-4f2e-9210-a3a5e2b95188 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:25.708012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c61a-6562-4833-8304-d2368f61ff0b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:25.751035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54d496-f11d-4ca9-9ddb-faa19792c26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:25.752773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54d496-f11d-4ca9-9ddb-faa19792c26b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.753304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54d496-f11d-4ca9-9ddb-faa19792c26b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.753755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54d496-f11d-4ca9-9ddb-faa19792c26b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.765992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54d496-f11d-4ca9-9ddb-faa19792c26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fb54d496-f11d-4ca9-9ddb-faa19792c26b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:25.776107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:25.777102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:25.777871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:25.779048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 55/105] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:25.780113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465facd2-4f26-43c0-a0a0-6edcb95b5e7e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.780576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465facd2-4f26-43c0-a0a0-6edcb95b5e7e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.780864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465facd2-4f26-43c0-a0a0-6edcb95b5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.801298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84eb94-e126-4f2e-9210-a3a5e2b95188 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:25.805836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-465facd2-4f26-43c0-a0a0-6edcb95b5e7e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:25.807071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-465facd2-4f26-43c0-a0a0-6edcb95b5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:25.834833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:25.842126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:25.842818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.843104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.843383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.844143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:25.844455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:25.846288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb18327-f44e-4a72-8543-9328ff80a44e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:25.856389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 51/106] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:25.857523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.857813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.858090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.874849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:25.876065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:25.887312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 56/107] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:25.891591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b536f0d-98f0-4c78-b317-13715c9616f7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:25.892125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b536f0d-98f0-4c78-b317-13715c9616f7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:25.892851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b536f0d-98f0-4c78-b317-13715c9616f7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:25.899022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 57/108] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:25.899022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b536f0d-98f0-4c78-b317-13715c9616f7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:25.920284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:25.955904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 52/109] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:25.957078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.033494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b536f0d-98f0-4c78-b317-13715c9616f7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.071283 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.072068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.072355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.072630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.073420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:26.073760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.075157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8badef-bec3-4326-9dd0-a861663b9be3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.083825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 58/110] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:01:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.085258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.085583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.085865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.090750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a01a7-5e74-4226-937a-02d54866d2c4 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.103663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:26.104877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:26.126101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.138557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.139478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.139764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.140054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.141377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.143262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.149488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 53/111] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:25 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.149488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.197520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.198135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 59/112] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:26.198675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.267328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7054f-c7b8-479d-afb8-c7f69f0a5ad9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.301654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.302393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.302677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.302970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.303300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126ff39-fdea-413d-9883-e5f0ce3a3a26 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.314468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:26.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:26.323009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:26.323782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 54/113] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:26.324395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.344062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.345007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.345268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.345577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.356370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:26.364181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:26.365101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:26.365915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 60/114] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:26.366523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.382794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.437355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.443244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df6c6-f23a-45e7-ade9-f3ac82b5f980 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.470617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e372505-cc63-4ff6-91ba-b2ce4fbd27c1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.479294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca38f90-9cb5-4254-9172-d649178e2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.480199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38f90-9cb5-4254-9172-d649178e2502 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.480485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38f90-9cb5-4254-9172-d649178e2502 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.480763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38f90-9cb5-4254-9172-d649178e2502 None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.482017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca38f90-9cb5-4254-9172-d649178e2502 None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.483478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca38f90-9cb5-4254-9172-d649178e2502 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.485171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 55/115] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.486933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb621-8e03-41c8-a0bb-7a0fa9538c4b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.487227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb621-8e03-41c8-a0bb-7a0fa9538c4b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.487506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285eb621-8e03-41c8-a0bb-7a0fa9538c4b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.488778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 56/116] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:26.493471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb621-8e03-41c8-a0bb-7a0fa9538c4b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.510203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.511079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.511359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.511659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.512819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.514328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.516055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 61/117] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.516879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.603214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285eb621-8e03-41c8-a0bb-7a0fa9538c4b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.603968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.625035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ada67-f47a-4339-9bb1-7236298a912d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.639661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.640484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.640774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.641075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.652417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:26.660276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:26.661370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:26.662158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:26.663500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.663679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 57/118] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:26.663754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.663754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.663754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.663950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.664031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:26.664031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.674917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 62/119] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.675775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.695412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.767144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24b83d-f72c-4a58-bf78-4721a9403447 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.779450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb394d-0698-4160-bf22-34fc0e3ba302 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.802329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.803017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.803328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.803602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.804357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:26.804664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.806099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a10c73-a1af-4e79-87d6-fd7f37773e9e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.814352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 58/120] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.814625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.815508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.815604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.815787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.815888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.816058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.816149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.817308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.818790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.820569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 63/121] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:26.821303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.832881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:26.834118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:26.836658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.901713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 59/122] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:26.902467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:26.922184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:26.924709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6550f-c7b0-4351-89e9-8d9a12110ca3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:26.959760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:26.960673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:26.960966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:26.961240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/2163e83cb8fa4cdb98d8294e2a7f2e22/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:26.963269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] RBAC: Authorizing `identity:create_grant(project_id=4844568f86af4cf5bcf73b85db238c05, user_id=2163e83cb8fa4cdb98d8294e2a7f2e22, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:26.964740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:26.979093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 64/123] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:26 2022] PUT /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/2163e83cb8fa4cdb98d8294e2a7f2e22/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:26.986647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.013214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1431c0-f8c2-49c9-967a-1d9f392e4eef None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.060336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.061054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.061368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.061647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.062452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:27.062879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.065005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.075590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 60/124] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:27.076411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.083075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.121533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc501d-3bf5-430e-801e-a497dad3d0ef None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.160363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.161463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.161811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.162096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.164289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.165812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.167806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 65/125] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:26 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:27.168284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.181858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.202493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1031a-817a-4f94-8428-6c55a1a234d6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.244209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.245114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.245473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.245729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] PATH_INFO: `/v3/users/3fce39df5bee40afae80b5528b48d2a8` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.261019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3fce39df5bee40afae80b5528b48d2a8)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.262544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.264536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 61/126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:27 2022] GET /identity/v3/users/3fce39df5bee40afae80b5528b48d2a8 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:27.265113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.295636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a918e0-8191-4a0a-beaf-f8ca193e56eb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.335851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.337065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.337578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.338043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/027a7e4e27d9446295cfe7447b23dd7b/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.340499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] RBAC: Authorizing `identity:create_grant(project_id=4844568f86af4cf5bcf73b85db238c05, user_id=027a7e4e27d9446295cfe7447b23dd7b, role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.342020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.355941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.369347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 66/127] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:27 2022] PUT /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/027a7e4e27d9446295cfe7447b23dd7b/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:27.371199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.418868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0708d-18d5-4821-a1fc-63ea869277e3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.465788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.466634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.466920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.467204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.468573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.471226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.473867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 62/128] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:27.479417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.489469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.524027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a727b-ab44-4dea-b883-62a04c8b4389 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.577773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.578687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.579100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.579290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.580537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.582075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.583766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 67/129] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:27 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:27.584557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.608172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad072f8e-a872-4d81-bd93-04218ce2eacd None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.653600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.654586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.654881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.655163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.656492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.658124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.660300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 63/130] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:27 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:27.660950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.674051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.724981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853389a2-e66a-4f4e-8361-f47a82f75e93 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.752178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.764492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.765309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.765633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.765907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.781439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876632d-577f-4ac6-8949-d65618a1bb91 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:27.825038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:27.825909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:27.826211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:27.826489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:27.827408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.829118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.852508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:27.854084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:27.862948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 64/131] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:01:27 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:27.863945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:27.940220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:27.982595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 68/132] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:27.989267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:28.000476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df483581-a891-456b-b876-a37d2c2a36a7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:28.033737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:28.055878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:28.056848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:28.057137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:28.057448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] PATH_INFO: `/v3/projects/724488c7cb0a40da8223d9289c766774` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:28.058893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] RBAC: Authorizing `identity:get_project(project_id=724488c7cb0a40da8223d9289c766774)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:28.060567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:28.062664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 65/133] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:27 2022] GET /identity/v3/projects/724488c7cb0a40da8223d9289c766774 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:28.070363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:28.119312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dea5b8-427c-46d0-94eb-28355e1e1257 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:28.160265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:28.161633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:28.162120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:28.162644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/027a7e4e27d9446295cfe7447b23dd7b/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:28.165288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] RBAC: Authorizing `identity:create_grant(project_id=4844568f86af4cf5bcf73b85db238c05, user_id=027a7e4e27d9446295cfe7447b23dd7b, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:28.167171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:28.186613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 69/134] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:27 2022] PUT /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/027a7e4e27d9446295cfe7447b23dd7b/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:28.188003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:28.233784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e16d0-e8c5-4487-8551-0feb9e09d67b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:28.241556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:28.291023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:28.292296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:28.292721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:28.293132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:28.294662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:28.297497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:28.303106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 66/135] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:28 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:28.309659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:28.342973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ffa5-183f-4390-bb2d-e77754049197 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:28.400831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:28.419978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f665-575c-4769-af5e-ec64a5d6fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:28.421012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f665-575c-4769-af5e-ec64a5d6fccf None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:28.421187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f665-575c-4769-af5e-ec64a5d6fccf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:28.421497 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f665-575c-4769-af5e-ec64a5d6fccf None admin] PATH_INFO: `/v3/projects/724488c7cb0a40da8223d9289c766774/users/027a7e4e27d9446295cfe7447b23dd7b/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:28.427075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6f665-575c-4769-af5e-ec64a5d6fccf None admin] RBAC: Authorizing `identity:create_grant(project_id=724488c7cb0a40da8223d9289c766774, user_id=027a7e4e27d9446295cfe7447b23dd7b, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:28.428685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6f665-575c-4769-af5e-ec64a5d6fccf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:28.449811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 70/136] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:28 2022] PUT /identity/v3/projects/724488c7cb0a40da8223d9289c766774/users/027a7e4e27d9446295cfe7447b23dd7b/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:28.457655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdac5b-e475-4b56-ba9a-eb49572167ce None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:28.498422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:28.499523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:28.500020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:28.500509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:28.502473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] RBAC: Adding query filter params (role.id=3b07ac183dc04a88839d50a4af4f356e, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=3fce39df5bee40afae80b5528b48d2a8) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:28.503030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:28.504912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c824-8c3c-40ba-ad39-c03600e0be7e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:28.511820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 67/137] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:28 2022] GET /identity/v3/role_assignments?user.id=3fce39df5bee40afae80b5528b48d2a8&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=3b07ac183dc04a88839d50a4af4f356e => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:29.542830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59dc7-9d7d-4b17-b3b6-73ab0e62e8ac None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:29.543314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59dc7-9d7d-4b17-b3b6-73ab0e62e8ac None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:29.543314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59dc7-9d7d-4b17-b3b6-73ab0e62e8ac None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:29.544690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 71/138] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:29.563195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:29.563717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:29.563915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:29.586008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:29.587215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:29.675647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 68/139] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:29.718683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59dc7-9d7d-4b17-b3b6-73ab0e62e8ac None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:29.831269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:29.837940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59dc7-9d7d-4b17-b3b6-73ab0e62e8ac None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:29.875828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:29.877189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:29.877189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:29.877487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:29.890420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:29.898640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:29.899560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:29.900772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 72/140] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:29.906151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:29.991369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:30.055897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657e551-51b0-4d9f-9804-f080b962d9c0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:30.100170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:30.100790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:30.101075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:30.101373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:30.102161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:30.102473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:30.103921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:30.118237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 69/141] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:30.123850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:30.237775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be8af9-a236-4cae-9bf3-fed857f5c060 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:30.281180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0e3df-11c9-424f-860d-ac2dfc075b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:30.282128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e3df-11c9-424f-860d-ac2dfc075b39 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:30.282455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e3df-11c9-424f-860d-ac2dfc075b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:30.282731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0e3df-11c9-424f-860d-ac2dfc075b39 None admin] PATH_INFO: `/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:30.290397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0e3df-11c9-424f-860d-ac2dfc075b39 None admin] RBAC: Authorizing `identity:get_user(user_id=2163e83cb8fa4cdb98d8294e2a7f2e22)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:30.291957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0e3df-11c9-424f-860d-ac2dfc075b39 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:30.294233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 73/142] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:30 2022] GET /identity/v3/users/2163e83cb8fa4cdb98d8294e2a7f2e22 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:30.299917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:30.432010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9755-9e3c-4fd3-bc09-822486fdef63 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:30.432319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9755-9e3c-4fd3-bc09-822486fdef63 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:30.432596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b9755-9e3c-4fd3-bc09-822486fdef63 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:30.434036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 74/143] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:30.439671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:30.440026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:30.440295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:30.444548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0e71-7798-4431-8dbc-e1e50bc4c5ac None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:30.458795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:30.460398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:30.473860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:30.482426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:30.483183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:30.483536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:30.483878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:30.493702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:30.553118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 75/144] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:30.581196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:30.582755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:30.590646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:30.783640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 70/145] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:01:30.789163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:30.795553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a97ff7-f42f-45ca-863e-a978be456605 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:30.841399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:30.843845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:30.844533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:30.845772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:30.846323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:30.877775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:30.895985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:30.896893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:30.897680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:30.911295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 76/146] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:30.918741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:30.929001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:31.051710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2fdc2-8755-47c4-89c2-81c990549731 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:31.077389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a807-1a3a-48bd-b3bc-59698f3ef7a7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:31.121663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:31.122971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.123486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.123950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.125452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:31.127402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:31.135629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 71/147] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:30 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:31.141833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:31.150587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:31.151488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.151770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.152046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.152817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:31.153128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:31.155136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:31.179211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 77/148] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:01:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:31.182064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:31.305837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:31.309875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:31.331956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a57bf-303f-4d35-801f-7512633f37e5 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:31.367566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303b61-a0d7-4a82-8437-a37446fe4a0e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:31.398955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:31.399667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.399942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.400223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.401078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=2163e83cb8fa4cdb98d8294e2a7f2e22) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:31.401425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:31.402918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c7873-bdc5-4516-b420-d98011967ab7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:31.413459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 72/149] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:31 2022] GET /identity/v3/role_assignments?user.id=2163e83cb8fa4cdb98d8294e2a7f2e22&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:31.415135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f8d4d-2052-4065-b5dd-0c7e08277f6d None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.415423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f8d4d-2052-4065-b5dd-0c7e08277f6d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.415700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f8d4d-2052-4065-b5dd-0c7e08277f6d None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.417410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 73/150] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:31.425273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633547c7-2511-42ab-938e-327fd2c181df None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.426072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633547c7-2511-42ab-938e-327fd2c181df None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.426493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633547c7-2511-42ab-938e-327fd2c181df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.433758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:31.433758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.433758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.433758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.434648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:31.436238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:31.441689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 78/151] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:31 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:31.449256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:31.479098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-633547c7-2511-42ab-938e-327fd2c181df None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:31.480321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-633547c7-2511-42ab-938e-327fd2c181df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:31.666712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 74/152] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:31.694458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633547c7-2511-42ab-938e-327fd2c181df None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:31.715089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026ce63-60a1-4bff-a868-6a1c97162ddb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:31.765141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aa626-a487-49ec-806f-173b51538e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:31.765803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aa626-a487-49ec-806f-173b51538e5f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.766088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aa626-a487-49ec-806f-173b51538e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.766366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aa626-a487-49ec-806f-173b51538e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.770759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:31.809468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:31.831554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633547c7-2511-42ab-938e-327fd2c181df None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:31.847075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aa626-a487-49ec-806f-173b51538e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:31.848809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aa626-a487-49ec-806f-173b51538e5f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:31.869177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bd1cd-9a11-4e7a-bf2f-e6a10d1b814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:31.870010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd1cd-9a11-4e7a-bf2f-e6a10d1b814f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.870315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd1cd-9a11-4e7a-bf2f-e6a10d1b814f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.870588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd1cd-9a11-4e7a-bf2f-e6a10d1b814f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.882096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bd1cd-9a11-4e7a-bf2f-e6a10d1b814f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-345bd1cd-9a11-4e7a-bf2f-e6a10d1b814f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:31.890447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:31.891313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:31.892257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 75/153] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:31.894680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8b21-09f8-473a-8bed-ee408581fa7d None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.894969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8b21-09f8-473a-8bed-ee408581fa7d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.895249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff8b21-09f8-473a-8bed-ee408581fa7d None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.896690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 76/154] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:31.897728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584860-b340-4949-a347-a3a4489f8d19 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.898015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584860-b340-4949-a347-a3a4489f8d19 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.898293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81584860-b340-4949-a347-a3a4489f8d19 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.899518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 77/155] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:31.904374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81584860-b340-4949-a347-a3a4489f8d19 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:31.974707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 79/156] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:31.976362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:31.976900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:31.977410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:31.994912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:31.996326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:32.020222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81584860-b340-4949-a347-a3a4489f8d19 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.026830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.057255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.057979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.058267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.058549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.059314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:32.059625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.061032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622350e-5e51-4f36-9abb-260336ba0dc7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.073432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 78/157] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:32.073432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.073432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.073432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.075721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 80/158] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:32.076575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.093797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.096343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:32.097968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:32.181360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 79/159] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:32.181360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.183432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9bad-d016-4cdd-a90e-0316ddcafe5c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.227129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.228370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.228837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.229396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.230887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.232776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.235167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 81/160] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:32.236538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.279087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.308645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e9a6-6f3d-4ce5-a082-477c74406d49 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.339992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.345486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.346412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.346697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.346976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.348296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.349853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.351629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 80/161] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:32.352441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.355703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4bf9-ddd7-47da-b1b1-9ddc67096715 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.395607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.396424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.396699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.396969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.407936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:32.415969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:32.416871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:32.417677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 82/162] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:32.418317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.464941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4ac77-a32c-4d90-aea1-84d53841fa0c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.499843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7d925-9c00-4d03-949f-c5b0dbe2b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.500554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7d925-9c00-4d03-949f-c5b0dbe2b6ea None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.500835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7d925-9c00-4d03-949f-c5b0dbe2b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.501143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7d925-9c00-4d03-949f-c5b0dbe2b6ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.502398 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7d925-9c00-4d03-949f-c5b0dbe2b6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.503867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7d925-9c00-4d03-949f-c5b0dbe2b6ea None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.505565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 81/163] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:32.506933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c43a-044a-49b6-9ee1-9eaeea0ce786 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.507224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c43a-044a-49b6-9ee1-9eaeea0ce786 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.507499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822c43a-044a-49b6-9ee1-9eaeea0ce786 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.508730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 82/164] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:32.509465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822c43a-044a-49b6-9ee1-9eaeea0ce786 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.519229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.527392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216cef2-cd36-4d49-9a4d-819a892e989d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.563189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.563896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.564182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.564535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.565439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] RBAC: Adding query filter params (role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=027a7e4e27d9446295cfe7447b23dd7b) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:32.565756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.567238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.573651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 83/165] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/role_assignments?user.id=027a7e4e27d9446295cfe7447b23dd7b&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:32.574488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.587399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.634244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822c43a-044a-49b6-9ee1-9eaeea0ce786 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.674225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f5199-b761-4710-a736-a3baa35583f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.675037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f5199-b761-4710-a736-a3baa35583f7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.675201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f5199-b761-4710-a736-a3baa35583f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.675468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f5199-b761-4710-a736-a3baa35583f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.715444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf11062-f285-45bd-b757-7dbf685b91a4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.753421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.754049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.754876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.754876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.755344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:32.756589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.757073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.760720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f5199-b761-4710-a736-a3baa35583f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.762346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f5199-b761-4710-a736-a3baa35583f7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.769163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 84/166] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:32.774737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.804502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.845521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:32.880659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 83/167] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:32.882770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.883066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.883345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.896027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75778825-fbcd-4e09-be69-bd1f0d1a1b26 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:32.901370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:32.902594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:32.933094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:32.933817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:32.934098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:32.934370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:32.935094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:32.936572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:32.958107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 85/168] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:32 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:32.962363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:32.980839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 84/169] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:32.981787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.067706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:33.098044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d8f1d-804c-412d-95f1-8acbd6285a37 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.100270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:33.105188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1adca7-75a9-4322-92cc-2f06b937bec9 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.146286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.146286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.146611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.146857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] PATH_INFO: `/v3/users/027a7e4e27d9446295cfe7447b23dd7b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.148533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.149402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] RBAC: Authorizing `identity:get_user(user_id=027a7e4e27d9446295cfe7447b23dd7b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:33.149512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.149761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.150665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.150766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:33.151833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:33.152307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 86/170] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/users/027a7e4e27d9446295cfe7447b23dd7b => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:33.157359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:33.157577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.157658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 85/171] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:32 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:33.161971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.307584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1b8b2-354e-48cd-8720-561f704ef715 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.311486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9042f34-4755-41a7-8d11-fe862b898b7c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.352023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.352881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.353253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.353627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.354896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.355588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.356092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.356373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.369893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:33.377861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:33.378912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 87/172] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:33.380129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.394312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:33.423632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:33.476434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:33.478422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:33.532165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59489b94-038f-4e26-9ad7-109c5139f313 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.572314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.573438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.574113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.574575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.575613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=027a7e4e27d9446295cfe7447b23dd7b) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:33.576125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:33.577849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:33.585513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 88/173] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/role_assignments?user.id=027a7e4e27d9446295cfe7447b23dd7b&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:33.586732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.630129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 86/174] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:33.636223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.729834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:33.793853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:33.814572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075bfed-8e2f-4372-9e4f-c461216ecfd9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.859635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b367a-a4d9-458b-9601-ee824accfaa9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:33.899405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.900124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.900496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.900770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.901366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:33.901564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:33.901873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:33.902261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:33.902540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:33.902812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] PATH_INFO: `/v3/projects/724488c7cb0a40da8223d9289c766774` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:33.903284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:33.904058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=724488c7cb0a40da8223d9289c766774)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:33.905797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:33.908408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 87/175] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/projects/724488c7cb0a40da8223d9289c766774 => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:33.920079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:33.921900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 89/176] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:33.929092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:34.115964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c962-0b7b-46e5-b193-0f298a58c3f0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:34.120723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925b907-2e45-49d7-9054-a08807ef33a1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:34.155442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:34.156132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:34.156417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:34.156956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:34.157449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:34.158430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=724488c7cb0a40da8223d9289c766774, user.id=027a7e4e27d9446295cfe7447b23dd7b) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:34.158785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:34.161345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:34.163881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:34.171743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 88/177] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/role_assignments?user.id=027a7e4e27d9446295cfe7447b23dd7b&scope.project.id=724488c7cb0a40da8223d9289c766774&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:34.173526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:34.174526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:34.174808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:34.175088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] PATH_INFO: `/v3/users/3fce39df5bee40afae80b5528b48d2a8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:34.176367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=3fce39df5bee40afae80b5528b48d2a8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:34.177923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:34.180009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 90/178] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:33 2022] GET /identity/v3/users/3fce39df5bee40afae80b5528b48d2a8 => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:34.185931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:34.300441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9f983-dfd9-48fa-a286-f2507dd0ce56 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:34.340617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e95e4e-9f8b-4635-914e-fd5067662f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:34.341545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e95e4e-9f8b-4635-914e-fd5067662f9b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:34.341826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e95e4e-9f8b-4635-914e-fd5067662f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:34.342101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e95e4e-9f8b-4635-914e-fd5067662f9b None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:34.343329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e95e4e-9f8b-4635-914e-fd5067662f9b None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:34.344861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e95e4e-9f8b-4635-914e-fd5067662f9b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:34.346897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 89/179] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:34 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:34.352960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:34.504433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e34006-18b0-404e-8c97-b86171988bf6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:34.561688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f859a6d-dc5e-4096-b241-a807ed61cb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:34.562614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f859a6d-dc5e-4096-b241-a807ed61cb8f None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:34.562899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f859a6d-dc5e-4096-b241-a807ed61cb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:34.563175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f859a6d-dc5e-4096-b241-a807ed61cb8f None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/3fce39df5bee40afae80b5528b48d2a8/roles/3b07ac183dc04a88839d50a4af4f356e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:34.565920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f859a6d-dc5e-4096-b241-a807ed61cb8f None admin] RBAC: Authorizing `identity:create_grant(project_id=4844568f86af4cf5bcf73b85db238c05, user_id=3fce39df5bee40afae80b5528b48d2a8, role_id=3b07ac183dc04a88839d50a4af4f356e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:34.567415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f859a6d-dc5e-4096-b241-a807ed61cb8f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:34.585532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 91/180] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:34 2022] PUT /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05/users/3fce39df5bee40afae80b5528b48d2a8/roles/3b07ac183dc04a88839d50a4af4f356e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:35.435360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f37e5-d5d9-41ae-9214-dce1efb6b0e2 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:35.436147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f37e5-d5d9-41ae-9214-dce1efb6b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:35.436147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f37e5-d5d9-41ae-9214-dce1efb6b0e2 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:35.437594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 90/181] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:35.443870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:35.444798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:35.445286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:35.465045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:35.466591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:35.535193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:35.553179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 92/182] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:35.576628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f37e5-d5d9-41ae-9214-dce1efb6b0e2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:35.653036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:35.695280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f37e5-d5d9-41ae-9214-dce1efb6b0e2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:35.732051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed498e-16b9-4a29-9796-7fd91bb5f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:35.732866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed498e-16b9-4a29-9796-7fd91bb5f451 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:35.733143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed498e-16b9-4a29-9796-7fd91bb5f451 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:35.733444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed498e-16b9-4a29-9796-7fd91bb5f451 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:35.746354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed498e-16b9-4a29-9796-7fd91bb5f451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-89ed498e-16b9-4a29-9796-7fd91bb5f451 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:35.754716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:35.755634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:35.756377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 91/183] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:35.762268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:35.880368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9167b-88d8-4692-bf77-79c1518c3c62 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:35.927557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:35.928318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:35.928602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:35.928877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:35.929713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:35.930020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:35.931474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:35.939532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5581-8d07-486f-bf9e-b2a0ea60d1e2 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:35.939876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5581-8d07-486f-bf9e-b2a0ea60d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:35.940102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5581-8d07-486f-bf9e-b2a0ea60d1e2 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:35.941606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 92/184] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:35.943017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 93/185] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:35.947213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b239b9-d92a-4786-a5a1-a487995a1e41 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:35.947596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b239b9-d92a-4786-a5a1-a487995a1e41 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:35.947963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b239b9-d92a-4786-a5a1-a487995a1e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:35.949202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:35.965486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-46b239b9-d92a-4786-a5a1-a487995a1e41 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:35.966699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-46b239b9-d92a-4786-a5a1-a487995a1e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:36.019962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.051194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 93/186] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:36.052582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d324-e274-4739-b722-2732431b2ebb None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.052868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d324-e274-4739-b722-2732431b2ebb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.053141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d324-e274-4739-b722-2732431b2ebb None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.054735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 94/187] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:36.063009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.063302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.063582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.083018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:36.084309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:36.086241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95cef4-ab5e-4607-9efe-04fc87942c23 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.124592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.125560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.125848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.126457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] PATH_INFO: `/v3/users/09300407a9ce46c89d614be1b1098e4c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.143668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] RBAC: Authorizing `identity:get_user(user_id=09300407a9ce46c89d614be1b1098e4c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.145078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.147055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 94/188] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:35 2022] GET /identity/v3/users/09300407a9ce46c89d614be1b1098e4c => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:36.148548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.148672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.168450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 95/189] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:36.169641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.296113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e61f30-b7ec-4d54-8def-e44d1a89a943 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.300910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05067470-564a-4d5d-b411-50b75da3b288 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.311839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.333800 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.334475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.334756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.335030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.340218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.341034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.341313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.341673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.342890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.344872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.347142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 95/190] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:36.349806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.398798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.414033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.415536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.465508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4045982-b17d-4e36-aa9c-1822b965c51c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.501653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.502664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.502958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.503232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.513713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:36.522129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:36.523037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:36.523805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:36.524419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 96/191] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:36.524820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 96/192] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:36.528307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.528570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.570112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.623915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.642000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcfbe4-d40d-47b5-9cdf-82163402a325 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.648298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d60b8-396f-484f-b238-57c9b6298a49 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.679296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.679985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.680366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.680539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.681256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.682779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.686219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.687098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.687374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.687643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.689158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.691412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.694247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 97/193] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:36.695261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.714481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 97/194] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:36 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:36.715444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.820978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f7e53-d912-4eae-84a9-d3acc2219a70 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.823871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:36.863300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.864004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.864282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.864557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.865352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:36.865695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.867214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.877231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 98/195] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:36.883188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:36.884270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737215a-5c00-4b1d-ae36-a2a96498287f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:36.927892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:36.928596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:36.928874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:36.929149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:36.931079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=09300407a9ce46c89d614be1b1098e4c) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:36.931079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:36.931915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2f7e2-37f0-4b58-a7f4-312eb2f62535 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:36.939523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 98/196] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/role_assignments?user.id=09300407a9ce46c89d614be1b1098e4c&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:37.008450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0928fee-258d-40a0-9c05-2c77df8dc5e3 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.008814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0928fee-258d-40a0-9c05-2c77df8dc5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.009576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0928fee-258d-40a0-9c05-2c77df8dc5e3 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.010871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 99/197] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:37.017806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.018146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.018407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.029902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b1e89-60f1-48fd-a024-3b428623e1fa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.031968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:37.039575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:37.040813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:37.076926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:37.078347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.078700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.080559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] PATH_INFO: `/v3/users/09300407a9ce46c89d614be1b1098e4c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.082341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] RBAC: Authorizing `identity:get_user(user_id=09300407a9ce46c89d614be1b1098e4c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:37.083671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:37.085504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 99/198] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:36 2022] GET /identity/v3/users/09300407a9ce46c89d614be1b1098e4c => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:37.091880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:37.135216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:37.141256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 100/199] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:37.165882 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:37.215332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ca769-3a6e-4d75-ae26-1d1258feed15 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.264307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:37.264967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.265245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.265567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.287228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff9e80-1852-4158-ac19-b92d8708f358 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.330076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:37.330915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.331196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.331474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.334923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:37.345138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:37.353553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:37.354474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:37.355267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 101/200] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:37.362701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:37.391389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:37.393063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:37.459027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:37.469368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e78de-81c7-4df0-8e9f-df37fc752ac5 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.507429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:37.508477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.508764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.509043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.509861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:37.510169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:37.511614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:37.521902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 102/201] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:37.527841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:37.597466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:37.628341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 100/202] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:01:37.634841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:37.649700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985295d4-a9f4-497b-a316-c36ad6bf71ae None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.688607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:37.689557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.689843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.690122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] PATH_INFO: `/v3/users/3fce39df5bee40afae80b5528b48d2a8` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.691784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] RBAC: Authorizing `identity:get_user(user_id=3fce39df5bee40afae80b5528b48d2a8)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:37.693508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:37.695256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 103/203] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:37 2022] GET /identity/v3/users/3fce39df5bee40afae80b5528b48d2a8 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:37.701296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:37.819462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de8f1d-df89-4efd-b8ff-7a0c1f8a6834 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.848806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:37.859164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:37.859842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:37.860129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:37.860516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:37.931548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531e3b9-bbda-4a81-aebe-5042c2af460d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:37.937346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:37.937346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:38.039305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:38.040578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:38.041058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:38.041630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:38.043054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:38.049366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:38.049501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 104/204] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:38.052021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 101/205] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:37 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:38.056927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:38.058056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:38.064567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:38.082963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:38.164116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781dcb9-c4ff-4a5f-a502-ab45421f6852 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:38.202754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:38.203646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:38.203948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:38.204814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:38.206321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:38.207944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:38.210200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 105/206] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:38 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:38.216052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:38.327829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5fc5e-4b0b-43ed-8c2e-e38900f5d589 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:38.329743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:38.341228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e89bb-eeb0-4088-a1c6-6a4b9a80df51 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:38.385187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:38.385904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:38.386193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:38.386464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:38.387310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] RBAC: Adding query filter params (role.id=3b07ac183dc04a88839d50a4af4f356e, scope.project.id=4844568f86af4cf5bcf73b85db238c05, user.id=3fce39df5bee40afae80b5528b48d2a8) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:38.387624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:38.389364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee85c-46d9-484f-b1b4-14e0730c4690 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:38.400671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 106/207] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:38 2022] GET /identity/v3/role_assignments?user.id=3fce39df5bee40afae80b5528b48d2a8&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=3b07ac183dc04a88839d50a4af4f356e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:38.417214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:38.417976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:38.418259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:38.418534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:38.419446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] RBAC: Adding query filter params (role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=09300407a9ce46c89d614be1b1098e4c) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:38.419763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:38.421293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e4ca5-f6f3-4ee7-9353-8e270fc93f71 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:38.435097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 102/208] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:38 2022] GET /identity/v3/role_assignments?user.id=09300407a9ce46c89d614be1b1098e4c&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 259 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:39.419953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575bcb-c92f-4a3e-94f4-5bd53206dff8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:39.420466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575bcb-c92f-4a3e-94f4-5bd53206dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:39.420570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1575bcb-c92f-4a3e-94f4-5bd53206dff8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:39.422184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 107/209] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:39.428086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:39.428523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:39.428695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:39.447258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:39.448843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:39.513467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:39.521426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 103/210] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:39.545447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575bcb-c92f-4a3e-94f4-5bd53206dff8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:39.654852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1575bcb-c92f-4a3e-94f4-5bd53206dff8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:39.697944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eb294-fbf0-4cdc-b278-77d96a8361cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:39.698821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eb294-fbf0-4cdc-b278-77d96a8361cd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:39.699100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eb294-fbf0-4cdc-b278-77d96a8361cd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:39.699383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eb294-fbf0-4cdc-b278-77d96a8361cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:39.710878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eb294-fbf0-4cdc-b278-77d96a8361cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d05eb294-fbf0-4cdc-b278-77d96a8361cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:39.718615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:39.721682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:39.723308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 108/211] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:39.727944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:39.805226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0af4-2ee3-4e90-b0f9-42278e2275f6 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:39.805525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0af4-2ee3-4e90-b0f9-42278e2275f6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:39.805848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0af4-2ee3-4e90-b0f9-42278e2275f6 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:39.807123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 109/212] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:39.812269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:39.812570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:39.812833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:39.831309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:39.832542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:39.836688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b68d9-7eb4-4f8a-97f3-e9fa895757ca None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:39.847973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:39.873975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:39.874661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:39.874942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:39.875218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:39.876078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:39.876394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:39.877951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:39.886943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 104/213] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:39.893228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:39.917471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 110/214] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:39.938124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:39.959531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.004182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c506cd5-b6e0-4503-8758-b065de5c2f28 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.039710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.040619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.040902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.041179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] PATH_INFO: `/v3/users/790abc9fc21d4155b960a77b9040ba3d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.057491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] RBAC: Authorizing `identity:get_user(user_id=790abc9fc21d4155b960a77b9040ba3d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.059484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.061770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 105/215] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:39 2022] GET /identity/v3/users/790abc9fc21d4155b960a77b9040ba3d => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:40.068247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:40.072759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1f731-7440-4c96-94fb-450833b96ca3 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.120233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.121058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.121360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.121659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.122869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.124804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.131660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 111/216] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:40.132878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:40.153154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.192644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f2b53-b87d-4e6a-a651-d95cada6638e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.209905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.234928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.237299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.238094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.238550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.257520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304f62c-6b9a-489a-b403-ed01491621df None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.296609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31046f-0d5e-4eed-8712-93ba27dd7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.297301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31046f-0d5e-4eed-8712-93ba27dd7714 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.297627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31046f-0d5e-4eed-8712-93ba27dd7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.298295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31046f-0d5e-4eed-8712-93ba27dd7714 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.298780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31046f-0d5e-4eed-8712-93ba27dd7714 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.300261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31046f-0d5e-4eed-8712-93ba27dd7714 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.315454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.317107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.327003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 112/217] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:40 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:40.328690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a2efe-a68b-4a9f-a0cc-6dd32e9eced6 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.329453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a2efe-a68b-4a9f-a0cc-6dd32e9eced6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.329453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a2efe-a68b-4a9f-a0cc-6dd32e9eced6 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.331372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 113/218] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:40.337302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.337642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.337898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.359886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:40.361397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:40.451354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 114/219] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:40.468288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:40.471297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.487049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 106/220] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:40.493454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:40.514549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.612020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca3b56-0bab-4708-aec9-97d7193cebba None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.628544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313507ce-02fc-4959-a015-0ae90182f741 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.666321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.667332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.667719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.668001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.676405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.677465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.677830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.678106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.679357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.680748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:40.680858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.682586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 107/221] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:40 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:40.688754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:40.689675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:40.690900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:40.691917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 115/222] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:40.698532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:40.786068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.811372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:40.833102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa6ce4-a44c-4c7c-9f1e-64226807ddaf None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.838853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c18283-bfd1-4df3-a30c-259a0b9899a6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:40.869295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.869918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.870199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.870472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.871307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=790abc9fc21d4155b960a77b9040ba3d) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:40.871619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.873092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8546847-1a6e-4127-8aae-61adddb7112d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.880175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 108/223] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:40 2022] GET /identity/v3/role_assignments?user.id=790abc9fc21d4155b960a77b9040ba3d&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:40.881290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56051ac-b4b8-404a-8751-a390d24ea2d5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.881612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56051ac-b4b8-404a-8751-a390d24ea2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.881883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56051ac-b4b8-404a-8751-a390d24ea2d5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.883392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 109/224] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:40.886402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:40.887132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.887624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.887724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.888802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:40.889128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:40.889459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:40.889738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:40.892571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:40.894625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:40.913703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 116/225] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:40.918156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:40.919211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:40.922463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:41.044492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 110/226] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:41.070401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:41.158628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae1f08-d270-4385-b8ba-cd0757661c9f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:41.178956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:41.203082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:41.214952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:41.215860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:41.216142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:41.216418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] PATH_INFO: `/v3/users/09300407a9ce46c89d614be1b1098e4c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:41.217810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] RBAC: Authorizing `identity:get_user(user_id=09300407a9ce46c89d614be1b1098e4c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:41.219299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:41.221363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 117/227] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:40 2022] GET /identity/v3/users/09300407a9ce46c89d614be1b1098e4c => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:41.226847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:41.231554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761b281-4b30-4d13-9c48-bb573a3f01d4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:41.314570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:41.315418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:41.315701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:41.315978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:41.343281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:41.351835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:41.352780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:41.354009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 111/228] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:41.372492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:41.385425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49b715-39c0-4eb5-a355-d45214a7261d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:41.435122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:41.436369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:41.437678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:41.438158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:41.441012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:41.446643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:41.448819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 118/229] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:41 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:41.455216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:41.540604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:41.574042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dfd08f-c439-48c7-81ac-91df652af350 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:41.620086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:41.621024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:41.621307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:41.621795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/09300407a9ce46c89d614be1b1098e4c/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:41.624502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750936ab-685a-444d-b548-a7bc9583e7d3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:41.628318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3792c49618f4887bc9c629ee78c5173, user_id=09300407a9ce46c89d614be1b1098e4c, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:41.632841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:41.654943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 119/230] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:41 2022] PUT /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/09300407a9ce46c89d614be1b1098e4c/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:01:41.691660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:41.692312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:41.692598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:41.692874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:41.693696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:41.694006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:41.695545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:41.710383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 112/231] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:01:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:41.711445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:41.717644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:41.862083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f202ec-e2e7-4d68-ba10-e2b446fa58b2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:41.884792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:41.903812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:41.904736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:41.905021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:41.905301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] PATH_INFO: `/v3/users/09300407a9ce46c89d614be1b1098e4c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:41.906765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=09300407a9ce46c89d614be1b1098e4c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:41.908577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:41.910445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 120/232] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:41 2022] GET /identity/v3/users/09300407a9ce46c89d614be1b1098e4c => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:41.916894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:42.052244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1eddb-3dc4-49b2-bd2a-a7a480211b50 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:42.102180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b65f-93fa-4ed4-afc8-2d3cbbb067b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:42.103105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b65f-93fa-4ed4-afc8-2d3cbbb067b5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:42.103386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b65f-93fa-4ed4-afc8-2d3cbbb067b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:42.103663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b65f-93fa-4ed4-afc8-2d3cbbb067b5 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:42.105080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b65f-93fa-4ed4-afc8-2d3cbbb067b5 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:42.106665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b65f-93fa-4ed4-afc8-2d3cbbb067b5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:42.108893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 113/233] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:41 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:42.114961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:42.279679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74de09b-c76f-4384-9896-4a2a496d6ae9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:42.337103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c5379-3a0a-492a-a4b1-d9f7b0fc1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:42.337984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c5379-3a0a-492a-a4b1-d9f7b0fc1807 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:42.338270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c5379-3a0a-492a-a4b1-d9f7b0fc1807 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:42.338549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c5379-3a0a-492a-a4b1-d9f7b0fc1807 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/09300407a9ce46c89d614be1b1098e4c/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:42.340860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c5379-3a0a-492a-a4b1-d9f7b0fc1807 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3792c49618f4887bc9c629ee78c5173, user_id=09300407a9ce46c89d614be1b1098e4c, role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:42.342387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c5379-3a0a-492a-a4b1-d9f7b0fc1807 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:42.371637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 121/234] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:42 2022] PUT /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/09300407a9ce46c89d614be1b1098e4c/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:42.951163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2bb0-d32a-48ab-ae3d-20c1c5095b1d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:42.952199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2bb0-d32a-48ab-ae3d-20c1c5095b1d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:42.952831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c2bb0-d32a-48ab-ae3d-20c1c5095b1d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:42.954835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 114/235] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:42.960796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:42.961284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:42.961600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:42.990999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:42.992582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:43.046114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:43.074905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 122/236] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:43.115736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c2bb0-d32a-48ab-ae3d-20c1c5095b1d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:43.223053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:43.278365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c2bb0-d32a-48ab-ae3d-20c1c5095b1d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:43.319267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfb45c-89fb-4684-8caa-c23c1c997b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:43.320095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfb45c-89fb-4684-8caa-c23c1c997b54 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.320370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfb45c-89fb-4684-8caa-c23c1c997b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.320634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfb45c-89fb-4684-8caa-c23c1c997b54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.321893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfb45c-89fb-4684-8caa-c23c1c997b54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:43.323385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfb45c-89fb-4684-8caa-c23c1c997b54 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:43.325520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 115/237] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:43.334513 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:43.367547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8c5e-3ece-41fc-8af9-d9d9c8715b05 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.368231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8c5e-3ece-41fc-8af9-d9d9c8715b05 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.368699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b8c5e-3ece-41fc-8af9-d9d9c8715b05 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.370639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 116/238] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:43.376504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.377604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.378291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.410063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:43.411749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:43.487359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 117/239] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:43.510980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:43.570270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f8cdc-0455-4607-bd2f-835426087241 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:43.602692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:43.629834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d3ce-08f6-4939-92dd-afcebecb938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:43.630181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6719a-d88d-46f6-81c6-fe64802b50d6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:43.630798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d3ce-08f6-4939-92dd-afcebecb938f None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.631182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d3ce-08f6-4939-92dd-afcebecb938f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.631553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d3ce-08f6-4939-92dd-afcebecb938f None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.632364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d3ce-08f6-4939-92dd-afcebecb938f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:43.634109 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d3ce-08f6-4939-92dd-afcebecb938f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:43.657852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 123/240] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:43 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:43.666239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c841b-98e1-43fb-a812-73bb11933883 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.666959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c841b-98e1-43fb-a812-73bb11933883 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.668152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c841b-98e1-43fb-a812-73bb11933883 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.670219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 124/241] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:43.679645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.680220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.680665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.692314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:43.695129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:43.696578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:43.697012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:43.718343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:43.718554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:43.719842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:43.727295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:43.728369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:43.729288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:43.732028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 118/242] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:43.738756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:43.788759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:43.887707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 125/243] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:43.929315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:43.946675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be8c51-a03b-4f07-941c-893c87d2d94b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:43.975608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:44.002825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.003926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.004656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.006748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.007586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:44.008498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:44.010332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:44.022214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 119/244] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:44.028667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.065786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8f82f-6faf-4ccb-b13a-2cee3fc7fa46 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.107506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.108338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.108623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.108898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.122113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:44.131369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:44.132305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:44.133070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:44.133686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 126/245] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:44.141446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.172888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6555967-8c28-4f11-a225-e89e85e09df8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.179871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:44.214988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.215888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.216163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.216434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] PATH_INFO: `/v3/users/7e7ab104d1f749c5820f7bcb87ff47af` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.247231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] RBAC: Authorizing `identity:get_user(user_id=7e7ab104d1f749c5820f7bcb87ff47af)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:44.248857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:44.253692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 120/246] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/users/7e7ab104d1f749c5820f7bcb87ff47af => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:44.258224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.280676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dfe80-0913-4b43-a34e-4c282025dca4 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.313734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:44.328107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.329666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.330095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.330677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.331682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:44.332380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:44.334662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:44.347894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 127/247] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:44.357683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.380738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5aec-eb31-4b1e-a156-f70ca5741b93 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.448559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4193e-14af-4f30-a065-5264149e59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.449233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4193e-14af-4f30-a065-5264149e59c5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.449542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4193e-14af-4f30-a065-5264149e59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.449820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4193e-14af-4f30-a065-5264149e59c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.507845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:44.530719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0efcb-994d-4dbf-ad2b-77075a9b93bf None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.548404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4193e-14af-4f30-a065-5264149e59c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:44.549959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4193e-14af-4f30-a065-5264149e59c5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:44.579556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27644773-93ee-4703-b687-3ec1228d2432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.580464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27644773-93ee-4703-b687-3ec1228d2432 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.580746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27644773-93ee-4703-b687-3ec1228d2432 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.581022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27644773-93ee-4703-b687-3ec1228d2432 None admin] PATH_INFO: `/v3/users/790abc9fc21d4155b960a77b9040ba3d` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.586155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27644773-93ee-4703-b687-3ec1228d2432 None admin] RBAC: Authorizing `identity:get_user(user_id=790abc9fc21d4155b960a77b9040ba3d)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:44.587704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27644773-93ee-4703-b687-3ec1228d2432 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:44.593504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 128/248] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/users/790abc9fc21d4155b960a77b9040ba3d => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:44.595001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf819db-38a5-4db6-8fc9-bf1d0e3d293b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.595294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf819db-38a5-4db6-8fc9-bf1d0e3d293b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.595576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf819db-38a5-4db6-8fc9-bf1d0e3d293b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.601343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 129/249] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:44.602458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf819db-38a5-4db6-8fc9-bf1d0e3d293b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.616312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:44.684023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 121/250] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:01:44.690374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.690944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.691438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.720254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:44.721512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:44.810749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 122/251] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:44.811919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.851753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf819db-38a5-4db6-8fc9-bf1d0e3d293b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.901103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:44.927901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:44.928801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:44.929081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:44.929369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:44.930612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:44.932081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:44.934216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 130/252] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:44.935101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:44.963411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ebb74-e8ef-4ebd-ad03-7fe9f005c911 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:44.975192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:45.016142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.017496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.017856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.018129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.019617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:45.021953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:45.025964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 123/253] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:45.026778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.151655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ec38f-6c47-42ef-976c-b7be8ff19ab9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.192856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.194148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.194756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.195252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.204556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d910e0-5744-4e26-8def-dd912070643d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.207684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:45.215892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:45.216767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:01:45.217565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:45.220311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 131/254] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:45.236994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.241028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55871e-f904-4861-8be6-3f0bbebb3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.241980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55871e-f904-4861-8be6-3f0bbebb3df6 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.242256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55871e-f904-4861-8be6-3f0bbebb3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.242550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55871e-f904-4861-8be6-3f0bbebb3df6 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/790abc9fc21d4155b960a77b9040ba3d/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.244606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55871e-f904-4861-8be6-3f0bbebb3df6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3792c49618f4887bc9c629ee78c5173, user_id=790abc9fc21d4155b960a77b9040ba3d, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:45.246131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55871e-f904-4861-8be6-3f0bbebb3df6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:45.261918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 124/255] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:45 2022] PUT /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/790abc9fc21d4155b960a77b9040ba3d/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:45.263827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d73ef-933e-43b5-9454-3369e75ef0ee None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.264092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d73ef-933e-43b5-9454-3369e75ef0ee None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.264416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d73ef-933e-43b5-9454-3369e75ef0ee None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.266072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 125/256] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:45.270675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d73ef-933e-43b5-9454-3369e75ef0ee None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.275860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:45.433706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d73ef-933e-43b5-9454-3369e75ef0ee None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.459565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:45.480043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.481280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.481595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.481867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.482627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:45.482931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:45.484234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c915-034a-47d4-a8f7-af4576034a53 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.484342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c35c9-d9f8-413e-8c9f-be7aaed9baa3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:45.494853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 126/257] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:45.496976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.497263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.497563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.519383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:45.521000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:45.531743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.532858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.533375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.533930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.534970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] RBAC: Adding query filter params (role.id=3b07ac183dc04a88839d50a4af4f356e, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=7e7ab104d1f749c5820f7bcb87ff47af) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:45.535598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:45.537285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:45.546132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 132/258] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:45 2022] GET /identity/v3/role_assignments?user.id=7e7ab104d1f749c5820f7bcb87ff47af&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=3b07ac183dc04a88839d50a4af4f356e => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:45.547371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.594358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:45.608213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 127/259] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:45.634214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.730631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2cb39-21b5-4556-b1ad-bde60492a30d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.756052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c71c4e-27b9-4a8b-a187-8ea6791b8a2e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.798125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.799110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.799388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.799721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.812478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:45.817272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.818638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.819115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.819580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] PATH_INFO: `/v3/users/09300407a9ce46c89d614be1b1098e4c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.820998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] RBAC: Authorizing `identity:get_user(user_id=09300407a9ce46c89d614be1b1098e4c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:45.825355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:45.826354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:01:45.827143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:45.827748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 128/260] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:45.829711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.830936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:45.833063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 133/261] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:45 2022] GET /identity/v3/users/09300407a9ce46c89d614be1b1098e4c => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:45.838745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:45.865747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:45.898581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:45.951489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a2a52-5694-4daa-9865-d2fc711e7854 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:45.994005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:45.994611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:45.994888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:45.995158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:45.995914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:45.996215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:45.997710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:46.012780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 129/262] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:01:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:46.014849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:46.119352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01b89-4aef-4910-b4b1-059ff4b04644 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:46.127865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6811b8-af77-43ea-9753-914ee2100598 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:46.162237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:46.167644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:46.168596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:46.169069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:46.169537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] PATH_INFO: `/v3/users/09300407a9ce46c89d614be1b1098e4c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:46.170805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=09300407a9ce46c89d614be1b1098e4c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:46.172301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:46.175129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 130/263] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:46 2022] GET /identity/v3/users/09300407a9ce46c89d614be1b1098e4c => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:46.181486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:46.232355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:46.232355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:46.232355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:46.232355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:46.295650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b271-41f9-4b56-b7b3-e7a45d0dc4c7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:46.331064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:46.331726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:46.332007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:46.332280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:46.348607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:46.358325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:46.382754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:46.405751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:46.406339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:46.410283 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:46.532656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 131/264] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:01:46.536111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:46.548533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 134/265] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:46.554094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:46.645755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:46.654132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1710396-23a2-4780-85fa-0e670e04e231 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:46.747288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:46.748178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:46.748453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:46.748725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:46.750015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:46.752972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:46.755473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 132/266] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:46 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:46.764818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:46.792014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aeb10-b8d9-4db0-afcd-e59dbbe8cd38 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:46.830776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:46.892302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:46.893479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:46.893949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:46.894238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:46.898295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:46.900305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:46.902146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 135/267] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:46 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:46.912372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:47.083775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604188b-c93d-4f35-a259-00c5d6d6335f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.161023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87f09e-4db5-402d-8414-b6d24169695c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.167492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:47.168237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.168532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.168761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.169603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] RBAC: Adding query filter params (role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=09300407a9ce46c89d614be1b1098e4c) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:47.169919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:47.171380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3fd38-4ccb-45a6-9658-0872ac2dffad None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:47.189747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 133/268] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:46 2022] GET /identity/v3/role_assignments?user.id=09300407a9ce46c89d614be1b1098e4c&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 608 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:47.191262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9dddc-7cc9-46ca-b085-17d6b392829a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.191549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9dddc-7cc9-46ca-b085-17d6b392829a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.191821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9dddc-7cc9-46ca-b085-17d6b392829a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.197973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 134/269] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:47.202097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d673-2842-4d20-8586-f2913a1aa4a8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.202408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d673-2842-4d20-8586-f2913a1aa4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.202659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427d673-2842-4d20-8586-f2913a1aa4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.242214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3427d673-2842-4d20-8586-f2913a1aa4a8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:47.243479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3427d673-2842-4d20-8586-f2913a1aa4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:47.254721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:47.255832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.256320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.256805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.258407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=09300407a9ce46c89d614be1b1098e4c) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:47.258937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:47.261621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:47.269697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:47.281961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 136/270] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:46 2022] GET /identity/v3/role_assignments?user.id=09300407a9ce46c89d614be1b1098e4c&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:47.367684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 135/271] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:47.405462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:47.474455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:47.501193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dff2b0-3fde-4296-8473-4988d56f4345 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.501509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dff2b0-3fde-4296-8473-4988d56f4345 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.501778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dff2b0-3fde-4296-8473-4988d56f4345 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.503386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 136/272] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:47.518764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.519053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.519328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.549967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:47.552224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:47.569592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b29643-b915-49b9-bbaf-67fbc26409da None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.613074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:47.614059 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.614403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.614740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.627531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:47.635781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:47.636638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:47.637856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 137/273] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:47.643338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:47.654396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 137/274] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:47.681878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:47.769934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a00d-ec7e-4544-9687-0582bc2152d1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.781487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:47.793238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:47.813748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:47.814752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.815100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.815458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.816268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:47.816627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:47.818628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:47.820117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415a9b1-0a32-4fcf-bf12-8edc20d2a710 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.827910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 138/275] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:47.833226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:47.857843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:47.858956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.859400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.859842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.861506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:47.863256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:47.865283 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 138/276] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:47.870907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:47.944474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e046-bb88-4c1a-93c1-72f2a7858d3b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.980080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5e94f-1a5a-4c45-b973-5703cc4dbd8f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:47.981164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:47.982305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:47.982688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:47.983023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] PATH_INFO: `/v3/users/1c55265c83dc4fba98d45f1251eeb052` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:47.998012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] RBAC: Authorizing `identity:get_user(user_id=1c55265c83dc4fba98d45f1251eeb052)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:47.999730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:48.001749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 139/277] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:47 2022] GET /identity/v3/users/1c55265c83dc4fba98d45f1251eeb052 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:48.007849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:48.018800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3d924-f8e8-4511-bcdf-485c9599213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:48.019756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d924-f8e8-4511-bcdf-485c9599213d None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.020325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d924-f8e8-4511-bcdf-485c9599213d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.020770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d924-f8e8-4511-bcdf-485c9599213d None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.021788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3d924-f8e8-4511-bcdf-485c9599213d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:48.023400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3d924-f8e8-4511-bcdf-485c9599213d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:48.041058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:48.053153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 139/278] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:01:47 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:01:48.148976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb6277-0611-431f-8ce2-0c06d526aab3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:48.245278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:48.246000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.246282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.246549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.247390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, user.id=1c55265c83dc4fba98d45f1251eeb052, scope.system=all) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:48.247696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:48.258196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb3b5-d7c9-40c2-b2c6-8682f80ca304 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:48.279686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 140/279] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 15 22:01:48 2022] GET /identity/v3/role_assignments?user.id=1c55265c83dc4fba98d45f1251eeb052&scope.system=all&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:48.505503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc85315-654e-4742-ac53-12dd1630aa76 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.505998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc85315-654e-4742-ac53-12dd1630aa76 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.505998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc85315-654e-4742-ac53-12dd1630aa76 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.507367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 140/280] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:48.516187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a865-ec7a-48b8-8b68-f328afeb091d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.516586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a865-ec7a-48b8-8b68-f328afeb091d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.516863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693a865-ec7a-48b8-8b68-f328afeb091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.544032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4693a865-ec7a-48b8-8b68-f328afeb091d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:48.545255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4693a865-ec7a-48b8-8b68-f328afeb091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:48.628886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 141/281] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:48.636259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2104d-7861-4f88-9639-d71509d7b6a6 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.636546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2104d-7861-4f88-9639-d71509d7b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.636826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2104d-7861-4f88-9639-d71509d7b6a6 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.638353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 141/282] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:48.643880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.644432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.644903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.654167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2104d-7861-4f88-9639-d71509d7b6a6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:48.661676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:48.664464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:48.665735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:48.686118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:48.752145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 142/283] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:48.787272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:48.827274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2104d-7861-4f88-9639-d71509d7b6a6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:48.911079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:48.911900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.912180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.912451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.919571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee18ad-5f1a-46a7-a9b0-bea112ce8a62 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:48.949986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:48.957597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:48.958415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:48.958587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:48.959399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:48.960565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:48.961164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:48.961164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:48.961290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 142/284] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:48.970474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:48.975651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:48.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:48.986358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:48.987923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 143/285] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:48.992859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:49.007196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:49.088330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:49.145219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d056ca0-90d5-4985-b15a-f55e3221074a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:49.160814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2008f-7341-4fe5-ad65-afd598272ed4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:49.218700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:49.219882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:49.220635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:49.221128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:49.222156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:49.222723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:49.224385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:49.232552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:49.233663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:49.235355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:49.235832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:49.241361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:49.241361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:49.241361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:49.241862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 143/286] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:49.248006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:49.263270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 144/287] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:49.268618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:49.416292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:49.456154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485507d1-cc31-44e6-b80e-41a9c4430a04 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:49.476237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ae94e-90f5-4559-8f49-e748395cc42e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:49.493732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:49.517009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:49.518767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:49.519260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:49.521561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] PATH_INFO: `/v3/users/7e7ab104d1f749c5820f7bcb87ff47af` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:49.523092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] RBAC: Authorizing `identity:get_user(user_id=7e7ab104d1f749c5820f7bcb87ff47af)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:49.526258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:49.529710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 144/288] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:49 2022] GET /identity/v3/users/7e7ab104d1f749c5820f7bcb87ff47af => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:49.535380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:49.552291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:49.553576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:49.554050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:49.554511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] PATH_INFO: `/v3/users/790abc9fc21d4155b960a77b9040ba3d` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:49.557606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] RBAC: Authorizing `identity:get_user(user_id=790abc9fc21d4155b960a77b9040ba3d)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:49.559388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:49.563161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 145/289] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:49 2022] GET /identity/v3/users/790abc9fc21d4155b960a77b9040ba3d => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:49.569920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:49.734227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3bef6-5cc9-445f-8971-77fedf92e134 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:49.743394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa16e8-f0c4-459f-91d0-a496b5783e65 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:49.780304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:49.780994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:49.781281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:49.781601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:49.797969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:49.813239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:49.814500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:49.814789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:49.815063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:49.816446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:49.817987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:49.825846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 145/290] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:49 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:49.831709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:49.865300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:49.866912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:49.957779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:49.977259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 146/291] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:49.987627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:50.040394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a7efa-b9ff-4f33-9158-21da925922da None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:50.069608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:50.130971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:50.131896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:50.132173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:50.132449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/7e7ab104d1f749c5820f7bcb87ff47af/roles/3b07ac183dc04a88839d50a4af4f356e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:50.134513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3792c49618f4887bc9c629ee78c5173, user_id=7e7ab104d1f749c5820f7bcb87ff47af, role_id=3b07ac183dc04a88839d50a4af4f356e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:50.135989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:50.142020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ad7d9-57bc-4d6c-b76e-2103c9aa16f7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:50.169679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 146/292] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:01:49 2022] PUT /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173/users/7e7ab104d1f749c5820f7bcb87ff47af/roles/3b07ac183dc04a88839d50a4af4f356e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:50.180950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6598e-dc60-4d5c-9703-622d319a208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:50.181895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6598e-dc60-4d5c-9703-622d319a208d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:50.182178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6598e-dc60-4d5c-9703-622d319a208d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:50.182456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6598e-dc60-4d5c-9703-622d319a208d None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:50.183804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6598e-dc60-4d5c-9703-622d319a208d None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:50.185489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6598e-dc60-4d5c-9703-622d319a208d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:50.187440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 147/293] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:49 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:50.194855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:50.393826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f44f26-43ac-4204-b36d-86872b1ee5b1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:50.456350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:50.489656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:50.490705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:50.491190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:50.491647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:50.493191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=790abc9fc21d4155b960a77b9040ba3d) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:50.493767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:50.496420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b990c4-ba37-48a4-aaba-43459d9c8718 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:50.509814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 147/294] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:50 2022] GET /identity/v3/role_assignments?user.id=790abc9fc21d4155b960a77b9040ba3d&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:50.919437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88bf8-c3cd-42f6-8d75-e265f2fb0ca2 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:50.919969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88bf8-c3cd-42f6-8d75-e265f2fb0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:50.920398 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88bf8-c3cd-42f6-8d75-e265f2fb0ca2 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:50.923470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 148/295] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:50.932206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:50.932206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:50.932206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:50.958120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:50.959855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:51.040287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6e9e-8dd8-4bca-845e-ebc3deb32bbb None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.040631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6e9e-8dd8-4bca-845e-ebc3deb32bbb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.040838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6e9e-8dd8-4bca-845e-ebc3deb32bbb None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.043655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 149/296] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:51.057113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.057772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.058249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.071204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 148/297] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:51.090938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:51.092149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:51.096596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.185690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 150/298] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:51.226853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.278412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:51.286151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b38bb1-8804-4204-b550-488d189cf138 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:51.316696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:51.355000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2f87e-6056-4971-9c49-59808cbca4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:51.355853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23824b84-4514-4728-953b-8a73e1a9ce94 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:51.356351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f87e-6056-4971-9c49-59808cbca4ff None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.356842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f87e-6056-4971-9c49-59808cbca4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.357352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f87e-6056-4971-9c49-59808cbca4ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.374988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2f87e-6056-4971-9c49-59808cbca4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8af2f87e-6056-4971-9c49-59808cbca4ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:51.390734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:51.392519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:51.394029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 149/299] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:51.396019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c5a5-f446-40ee-b99b-a4d5f4a86104 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.396019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c5a5-f446-40ee-b99b-a4d5f4a86104 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.396424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c5a5-f446-40ee-b99b-a4d5f4a86104 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.399135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 150/300] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:51.400573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c5a5-f446-40ee-b99b-a4d5f4a86104 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.402725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903627d-a55d-4911-9d15-8a88518f10b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:51.403863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903627d-a55d-4911-9d15-8a88518f10b9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.404232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903627d-a55d-4911-9d15-8a88518f10b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.404580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903627d-a55d-4911-9d15-8a88518f10b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.405933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903627d-a55d-4911-9d15-8a88518f10b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:51.407769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903627d-a55d-4911-9d15-8a88518f10b9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:51.409586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 151/301] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:51.409586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.409586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.409586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.429806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:51.431102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:51.528155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c5a5-f446-40ee-b99b-a4d5f4a86104 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:51.534446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 152/302] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:51.535015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.572563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:51.573281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.573584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.573870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.574634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:51.574947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:51.576349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:51.587106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 151/303] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:51.587768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.595919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:51.637143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:51.674750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fada1e-5ca3-444c-a91d-99e3799b32ab None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:51.714004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:51.714707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.714988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.715262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] PATH_INFO: `/v3/groups` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.715975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:51.717517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:51.749360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 153/304] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jun 15 22:01:51 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:51.749360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.749668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fff5d9-2e3e-407a-aa81-cfe39622bc5b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:51.810579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:51.811947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.812453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.812949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.833107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:51.846674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:51.847616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:51.848484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:51.849952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 152/305] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:51.859823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:51.878290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:51.887739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4f88-fbbd-4565-9330-bc77cb42abea None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:51.938641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:51.940274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:51.941538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:51.941538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] PATH_INFO: `/v3/users/bf88232496824bb0a46007f87698abfe` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:51.963669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] RBAC: Authorizing `identity:get_user(user_id=bf88232496824bb0a46007f87698abfe)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:51.965721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:51.967663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 154/306] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/users/bf88232496824bb0a46007f87698abfe => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:51.974653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:52.033437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:52.044222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400e83-925a-4840-9cd1-b33d833e5d33 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:52.089996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:52.090861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:52.091156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:52.091437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:52.092881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:52.093351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:52.095041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:52.108670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 153/307] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:52.115374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:52.176656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e906a-0946-4b24-922a-005ada9e60fc None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:52.257548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235acfe-56af-4030-9078-90bb4ab53ce6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:52.271834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:52.274322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:52.275088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:52.276001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:52.278988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] RBAC: Adding query filter params (role.id=3b07ac183dc04a88839d50a4af4f356e, user.id=bf88232496824bb0a46007f87698abfe, scope.system=all) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:52.279825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:52.283658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:52.306024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 155/308] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 15 22:01:51 2022] GET /identity/v3/role_assignments?user.id=bf88232496824bb0a46007f87698abfe&scope.system=all&role.id=3b07ac183dc04a88839d50a4af4f356e => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:52.311638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7386f1a-2313-4f72-9935-0aeb23c6f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:52.312580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386f1a-2313-4f72-9935-0aeb23c6f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:52.312854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386f1a-2313-4f72-9935-0aeb23c6f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:52.313160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7386f1a-2313-4f72-9935-0aeb23c6f5ac None admin] PATH_INFO: `/v3/users/1c55265c83dc4fba98d45f1251eeb052` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:52.314563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7386f1a-2313-4f72-9935-0aeb23c6f5ac None admin] RBAC: Authorizing `identity:get_user(user_id=1c55265c83dc4fba98d45f1251eeb052)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:52.316071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7386f1a-2313-4f72-9935-0aeb23c6f5ac None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:52.318218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 154/309] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:52 2022] GET /identity/v3/users/1c55265c83dc4fba98d45f1251eeb052 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:52.324233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:52.373514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:52.449563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7af71e-e5e9-4635-9cd9-8870048e42cb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:52.510345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce1fd9-a107-425b-84c0-93a43824a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:52.512294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1fd9-a107-425b-84c0-93a43824a965 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:52.512999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1fd9-a107-425b-84c0-93a43824a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:52.513723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce1fd9-a107-425b-84c0-93a43824a965 None admin] PATH_INFO: `/v3/system/users/1c55265c83dc4fba98d45f1251eeb052/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:52.516957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce1fd9-a107-425b-84c0-93a43824a965 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c55265c83dc4fba98d45f1251eeb052, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:52.519486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce1fd9-a107-425b-84c0-93a43824a965 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:52.537955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 156/310] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jun 15 22:01:52 2022] PUT /identity/v3/system/users/1c55265c83dc4fba98d45f1251eeb052/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:01:53.715162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f1361-a5f9-454f-8ae2-6e9a15b7d85b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:53.715781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f1361-a5f9-454f-8ae2-6e9a15b7d85b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:53.715781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f1361-a5f9-454f-8ae2-6e9a15b7d85b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:53.717483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 155/311] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:53.725026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:53.726258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:53.726803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:53.749205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:53.750985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:53.832146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 157/312] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:53.872616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f1361-a5f9-454f-8ae2-6e9a15b7d85b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:53.920503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:54.012686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f1361-a5f9-454f-8ae2-6e9a15b7d85b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:54.051413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:54.052264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.052543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.052810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.066206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:54.074657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:54.076373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:54.077989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 156/313] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:54.091326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:54.112091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:54.213467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d57ff-3d2c-4bc8-b02f-bf4795ebbc75 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:54.266959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:54.267717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.268001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.268278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.269224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:54.269639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:54.271123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:54.282449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 158/314] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:54.289365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:54.425858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:54.434772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e0a15-467a-4c8c-9b3e-e21e99e1f8f2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:54.476999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e694-236f-437c-befa-e9366677f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:54.477987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e694-236f-437c-befa-e9366677f675 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.478363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e694-236f-437c-befa-e9366677f675 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.478639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e694-236f-437c-befa-e9366677f675 None admin] PATH_INFO: `/v3/users/7e7ab104d1f749c5820f7bcb87ff47af` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.479963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e694-236f-437c-befa-e9366677f675 None admin] RBAC: Authorizing `identity:get_user(user_id=7e7ab104d1f749c5820f7bcb87ff47af)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:54.481620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e694-236f-437c-befa-e9366677f675 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:54.483745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 157/315] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:54 2022] GET /identity/v3/users/7e7ab104d1f749c5820f7bcb87ff47af => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:54.490096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:54.504162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4d3af-10f1-4406-8fa0-55878805968e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.504474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4d3af-10f1-4406-8fa0-55878805968e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.504728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4d3af-10f1-4406-8fa0-55878805968e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.506562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 158/316] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:01:54.512324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.512613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.512899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.532560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:54.534150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:54.605793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:54.637731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea635f-8016-4de9-8b5f-5ac0e3ca1fe0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:54.665378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 159/317] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:54.691707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:54.692405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.692693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.692974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.698031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:54.786343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:54.788135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:54.812461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:54.834410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ca7d-f3cb-4ab4-82d9-3d36480a3294 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:54.876600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:54.884767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:54.886205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:54.886779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:54.887326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:54.889112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:54.891219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:54.893416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 160/318] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:54.901982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:54.921069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 159/319] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:54.927651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.051596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d905681-a415-447e-8bf0-893f35f40e36 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:55.051954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee38e2-f730-4a75-9d51-376dd8723de2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:55.093394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:55.094649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.094983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.095210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] PATH_INFO: `/v3/groups` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.096213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:55.096321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc258d-2196-4fdc-a8e3-ec20ae98d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:55.097434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc258d-2196-4fdc-a8e3-ec20ae98d07b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.097795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc258d-2196-4fdc-a8e3-ec20ae98d07b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.097900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:55.098142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc258d-2196-4fdc-a8e3-ec20ae98d07b None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.099623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc258d-2196-4fdc-a8e3-ec20ae98d07b None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:55.101361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc258d-2196-4fdc-a8e3-ec20ae98d07b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:55.109575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 160/320] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:01:54 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:55.109575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e6bb-5c39-4106-8687-1ac567a3a2ba None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.109575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e6bb-5c39-4106-8687-1ac567a3a2ba None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.109575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e6bb-5c39-4106-8687-1ac567a3a2ba None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.109575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 161/321] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:55.114532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.114964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.115204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.126688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 161/322] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jun 15 22:01:54 2022] POST /identity/v3/groups => generated 226 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:01:55.127824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.135395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:55.136730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:55.154545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:55.189170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:55.231286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 162/323] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:01:55.260513 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.282593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a676-f233-4348-bbec-e51f93bec968 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:55.330311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:55.332012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.332694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.334040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.336053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] RBAC: Adding query filter params (role.id=3b07ac183dc04a88839d50a4af4f356e, scope.project.id=c3792c49618f4887bc9c629ee78c5173, user.id=7e7ab104d1f749c5820f7bcb87ff47af) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:55.336905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:55.341362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16965890-2560-4d3b-9b2d-3449a2d36712 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:55.357466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 162/324] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:01:55 2022] GET /identity/v3/role_assignments?user.id=7e7ab104d1f749c5820f7bcb87ff47af&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=3b07ac183dc04a88839d50a4af4f356e => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:55.359325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51abe9-3a82-473b-b716-27c2a66d74ba None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.359801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51abe9-3a82-473b-b716-27c2a66d74ba None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.361990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51abe9-3a82-473b-b716-27c2a66d74ba None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.369250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 163/325] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:55.371113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.371414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.371757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.396262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:55.397822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:55.403624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5984cc8-a043-41c8-aff6-bd0feec434da None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:55.465838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:55.467642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.468317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.468912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.494228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:55.503018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:55.504014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:01:55.504828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 163/326] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:01:55.506076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 164/327] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:55.511247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.552791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.565785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:55.572667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:55.689980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cd9f0-ba06-4a2d-8d3d-ee700a8df4c6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:55.752813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb3588-5b35-4481-ac31-dea471f3db97 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:55.759615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:55.760811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.761451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.761925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.763387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:55.764059 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:55.768470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:55.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 164/328] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:55.800135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.805037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:55.806422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:55.806867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:55.808281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:55.823841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:55.834496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:55.835636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:01:55.836586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:55.840228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 165/329] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:55.847438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:55.986356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:56.011418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:56.027813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3d21d-c5b1-41a8-a04c-be9c43e6a945 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:56.043826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd373a5b-5f1d-40d3-b9cf-b7502ae14526 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:56.102790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:56.104711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:56.105524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:56.106201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] PATH_INFO: `/v3/users/1c55265c83dc4fba98d45f1251eeb052` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:56.108690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] RBAC: Authorizing `identity:get_user(user_id=1c55265c83dc4fba98d45f1251eeb052)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:56.112541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:56.116682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 165/330] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:55 2022] GET /identity/v3/users/1c55265c83dc4fba98d45f1251eeb052 => generated 293 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:56.119599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:56.119599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:56.119599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:56.119599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:56.120780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:56.121248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:56.123554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:56.124106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:56.142575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 166/331] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:56.153800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:56.406057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4f9dc-ae42-4ebc-8298-43aad142bbb2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:56.419248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924a72a-35e3-41f3-ab77-72ae4ae71230 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:56.476687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:56.477855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:56.477984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:56.478885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:56.479513 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:56.481112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] RBAC: Adding query filter params (role.id=b00b4e9815664c168438c3cc4e734a6f, user.id=1c55265c83dc4fba98d45f1251eeb052, scope.system=all) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:56.481691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:56.485347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:56.504484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f4ffa-1839-48fc-8838-cf6e282d204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:56.505873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f4ffa-1839-48fc-8838-cf6e282d204a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:56.506307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f4ffa-1839-48fc-8838-cf6e282d204a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:56.506741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f4ffa-1839-48fc-8838-cf6e282d204a None admin] PATH_INFO: `/v3/users/bf88232496824bb0a46007f87698abfe` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:56.508543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 166/332] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 15 22:01:56 2022] GET /identity/v3/role_assignments?user.id=1c55265c83dc4fba98d45f1251eeb052&scope.system=all&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 510 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:56.510200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f4ffa-1839-48fc-8838-cf6e282d204a None admin] RBAC: Authorizing `identity:get_user(user_id=bf88232496824bb0a46007f87698abfe)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:56.511819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f4ffa-1839-48fc-8838-cf6e282d204a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:56.513846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 167/333] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:01:56 2022] GET /identity/v3/users/bf88232496824bb0a46007f87698abfe => generated 293 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:01:56.521780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:56.562811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:56.679434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf397e9-d99e-433d-9a51-9767c42d62ae None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:56.724489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845c636-561c-44e9-8e34-3fd4158f01da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:56.725609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845c636-561c-44e9-8e34-3fd4158f01da None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:56.725904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845c636-561c-44e9-8e34-3fd4158f01da None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:56.726213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845c636-561c-44e9-8e34-3fd4158f01da None admin] PATH_INFO: `/v3/system/users/bf88232496824bb0a46007f87698abfe/roles/3b07ac183dc04a88839d50a4af4f356e` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:56.728224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845c636-561c-44e9-8e34-3fd4158f01da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bf88232496824bb0a46007f87698abfe, role_id=3b07ac183dc04a88839d50a4af4f356e)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:56.729835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845c636-561c-44e9-8e34-3fd4158f01da None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:56.742323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 167/334] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jun 15 22:01:56 2022] PUT /identity/v3/system/users/bf88232496824bb0a46007f87698abfe/roles/3b07ac183dc04a88839d50a4af4f356e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:01:58.568588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813cdf9-ad20-46dc-8bde-b0914bf3f60f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:58.570054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813cdf9-ad20-46dc-8bde-b0914bf3f60f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:58.570772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813cdf9-ad20-46dc-8bde-b0914bf3f60f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:58.573746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 168/335] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:58.583602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:58.585063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:58.585802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:58.631322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:58.633921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:58.798985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 168/336] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:58.836841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813cdf9-ad20-46dc-8bde-b0914bf3f60f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:59.043850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813cdf9-ad20-46dc-8bde-b0914bf3f60f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:59.107807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:59.108991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.109674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.110415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.128848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:01:59.143748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:01:59.145816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:01:59.147110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:01:59.153788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 169/337] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:01:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:01:59.159842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:59.191144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:59.331587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d14f4-1f07-498c-9fd2-fee077955fcb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:59.392393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:59.392995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.393279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.393589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.394365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:01:59.394750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:59.396162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74cc50-8f68-4cb6-a69b-f54afa9d7ea9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:59.410477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 169/338] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:01:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:01:59.416772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:01:59.547185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:59.559123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb4fc-78bf-4d34-bc3e-c7a1921a5202 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.559510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb4fc-78bf-4d34-bc3e-c7a1921a5202 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.559694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb4fc-78bf-4d34-bc3e-c7a1921a5202 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.561209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 170/339] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:59.570917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca48fc-ca17-4896-99fd-1fe151dbfd32 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.571252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca48fc-ca17-4896-99fd-1fe151dbfd32 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.571489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca48fc-ca17-4896-99fd-1fe151dbfd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.616605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-96ca48fc-ca17-4896-99fd-1fe151dbfd32 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:59.617864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-96ca48fc-ca17-4896-99fd-1fe151dbfd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:59.625653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4fad4-a8ba-4941-adcd-fe33f20dd840 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:01:59.686044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:01:59.686964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.687477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.687952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.817844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:01:59.820119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:01:59.847151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 171/340] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:01:59.848812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f4cd-d185-48f4-8d8d-971bee05b5a8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.849268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f4cd-d185-48f4-8d8d-971bee05b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.849772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f4cd-d185-48f4-8d8d-971bee05b5a8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.851280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 172/341] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:01:59.857046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:01:59.857589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:01:59.858005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:01:59.897510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:59.915896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:01:59.921774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:01:59.926248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:01:59.989297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 170/342] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:01:59.990785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:00.146342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 173/343] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:00.148767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:00.291186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a8fd2-42a8-446e-b71d-facf0618a01c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:00.364458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330355cc-89b5-433f-92d8-1a8f16b19e27 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:00.394217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:00.395379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:00.395799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:00.396387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:00.419197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:00.420137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:00.420429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:00.420712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:00.425228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:00.426802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:00.428979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 174/344] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:00 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:00.430392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:00.442087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:00.444162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:00.445081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:00.445959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 171/345] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:01:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:00.450028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:00.455165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:00.504150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:00.590442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e128aa9-f6ae-4553-93d5-fe6b1c14733b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:00.650841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:00.651707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:00.652137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:00.652612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:00.684966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9447c51-32c4-4fea-b370-12424bef44f7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:00.686866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:00.708877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:00.710047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:00.711041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:00.711658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 175/346] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:00.712932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:00.740279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:00.741232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:00.741542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:00.741816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:00.749799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:00.751544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:00.754009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 172/347] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:00 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:00.755231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:00.881823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:00.901849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:00.919287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb58b2e-2512-45ab-bd53-be8b92e6b572 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:00.963748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:00.964584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:00.964879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:00.965163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:00.966082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:00.966437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:00.968117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:00.972372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aff1e-7d8b-4d01-ba05-a2384e3bd124 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:00.980071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 173/348] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:02:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:00.981799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:01.023853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:01.024960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.025530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.026018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.027070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:01.027664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:01.029354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb4cae-a834-48b6-b53e-b9b0d62728b9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:01.041144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 176/349] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:01.043118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d7d8-7b46-4bd0-b5c2-1c844a51995e None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.043684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d7d8-7b46-4bd0-b5c2-1c844a51995e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.044200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d7d8-7b46-4bd0-b5c2-1c844a51995e None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.046296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 177/350] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:01.048400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf0c39-1aa1-4b97-b555-6eb02cc64cbe None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.049005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf0c39-1aa1-4b97-b555-6eb02cc64cbe None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.049377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf0c39-1aa1-4b97-b555-6eb02cc64cbe None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.051318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 178/351] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:01.052167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf0c39-1aa1-4b97-b555-6eb02cc64cbe None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:01.189668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56084b25-858a-453c-bcc3-386b3caf3860 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:01.213223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf0c39-1aa1-4b97-b555-6eb02cc64cbe None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:01.246321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:01.247254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.247745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.248179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.249776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=4844568f86af4cf5bcf73b85db238c05) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:01.250286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:01.253360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:01.255083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:01.263531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 174/352] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:00 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 260 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:01.264924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:01.275493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57274ff8-802b-4536-8da9-dea4e773b46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:01.276915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:01.277500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274ff8-802b-4536-8da9-dea4e773b46d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.278474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274ff8-802b-4536-8da9-dea4e773b46d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.278650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57274ff8-802b-4536-8da9-dea4e773b46d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.420367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57274ff8-802b-4536-8da9-dea4e773b46d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:01.422497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57274ff8-802b-4536-8da9-dea4e773b46d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:01.436640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9ea06-2ced-4620-880a-7f6d549868d5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:01.502095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc84344-c535-4d60-b1f6-950454172214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:01.503041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84344-c535-4d60-b1f6-950454172214 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.503368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84344-c535-4d60-b1f6-950454172214 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.503704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc84344-c535-4d60-b1f6-950454172214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.601199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 179/353] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:01.603767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424988-50c9-4887-b48b-db8b5279dbf4 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.604537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424988-50c9-4887-b48b-db8b5279dbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.605078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424988-50c9-4887-b48b-db8b5279dbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.626237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc84344-c535-4d60-b1f6-950454172214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:01.627285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc84344-c535-4d60-b1f6-950454172214 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:01.628820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-72424988-50c9-4887-b48b-db8b5279dbf4 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:01.631437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-72424988-50c9-4887-b48b-db8b5279dbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:01.639000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:01.671072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:01.752649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 180/354] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:01.754086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.754442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.754918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.776924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:01.778450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:01.817088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 175/355] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:01.819555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c109d-4cfd-47be-a683-1f84b41ef109 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:01.820122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c109d-4cfd-47be-a683-1f84b41ef109 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:01.820694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c109d-4cfd-47be-a683-1f84b41ef109 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:01.823254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 176/356] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:01.825676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c109d-4cfd-47be-a683-1f84b41ef109 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:01.897768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 181/357] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:01.899322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:01.979901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c109d-4cfd-47be-a683-1f84b41ef109 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:01.993006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:02.036505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.038027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.038328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.038808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.041194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:02.045392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:02.046207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:02.047397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 177/358] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:01 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:02.047958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.076527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49af8c-34d1-492c-b5a6-707094d799e1 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.135391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee930fe-7f68-41a1-9f95-79128685e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.136843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee930fe-7f68-41a1-9f95-79128685e5fa None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.137486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee930fe-7f68-41a1-9f95-79128685e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.138255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee930fe-7f68-41a1-9f95-79128685e5fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.156913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee930fe-7f68-41a1-9f95-79128685e5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5ee930fe-7f68-41a1-9f95-79128685e5fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:02.167209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:02.169143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:02.171111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:02.178417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 182/359] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:02:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:02.178417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.178417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.178417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.202998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:02.208541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:02.212232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1744f-5e25-4171-9ed6-b1f085e6d09b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.275272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.276548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.277029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.277541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.279077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:02.280577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:02.283409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 178/360] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:02.284527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.336940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 183/361] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:02.338010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.366876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:02.450991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7d4d-99f4-4137-bbdc-28720556eb59 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.452783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:02.490747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886880-0834-4d45-bbd8-87f0e72fa658 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.506762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.507931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.508408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.508873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.536101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:02.543879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.545617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.546288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:02.546539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:02.547962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 22:02:02.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:02.550425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.550425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:02.550627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 179/362] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:02.551556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:02.551769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.553579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 184/363] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:02.560361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.712743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d518f-f836-4d30-931d-a2a9a063ab29 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.730103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f616-07ec-4179-af34-3d7168cf9146 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.732632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:02.766584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.768888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.769426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.770077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.771925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:02.774180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:02.776622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 185/364] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:02.777835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.801946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:02.802651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:02.802938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:02.803221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:02.804121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:02.804462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:02.806078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:02.820103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 180/365] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:02.820103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:02.821680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:02.975885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befbb660-9205-4a6a-8cf5-3d02c762e771 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:02.991408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb789799-0d11-46d9-a7ef-f5ba6a04c95f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:03.030682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.034440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.034440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.034440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.044434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.045263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.045768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.046197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.047233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=c3792c49618f4887bc9c629ee78c5173) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:03.047662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:03.048851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:03.049639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:03.057371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:03.066288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:03.067189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 186/367] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:03.067829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 181/367] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:02 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:03.067912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.067978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.117831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:03.201923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:03.246817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68273441-6828-4dc9-995a-60044d7ca0f4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:03.256478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603c94-e6b4-4cc9-aa77-6ffe8184a7d9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:03.302003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.302987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.303478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.303894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.305022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=4844568f86af4cf5bcf73b85db238c05) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:03.305515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:03.307278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:03.313386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.314318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.314772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.315182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.321424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:03.321424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:03.321424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:03.321796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 182/368] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:03.322875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.330605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 187/369] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:03.331674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.554421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c264bad-1aa7-4d2b-bdcd-c8b5b869b675 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:03.568622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:03.579957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed1f8-1611-4ea7-88b8-e17ed17f624a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:03.630048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d444f-f945-480a-83dd-1653d11ec06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.630655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.630778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d444f-f945-480a-83dd-1653d11ec06c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.631087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d444f-f945-480a-83dd-1653d11ec06c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.631432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d444f-f945-480a-83dd-1653d11ec06c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.631528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.631722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.632017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.633090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:03.633475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:03.635103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:03.636971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:03.659995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 188/370] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:03.660935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.753137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d444f-f945-480a-83dd-1653d11ec06c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:03.755633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d444f-f945-480a-83dd-1653d11ec06c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:03.826949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8d8fb-0e61-4d7f-a5c9-47f51f52c76d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:03.883767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:03.885521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.885893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.886319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] PATH_INFO: `/v3/users/bf88232496824bb0a46007f87698abfe` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.888493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] RBAC: Authorizing `identity:get_user(user_id=bf88232496824bb0a46007f87698abfe)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:03.890577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:03.892621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 189/371] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/users/bf88232496824bb0a46007f87698abfe => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:03.893639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.906324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:03.923603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 183/372] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:03.926306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a725c2-6bcd-4a34-aba7-31b842b81e5e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:03.926813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a725c2-6bcd-4a34-aba7-31b842b81e5e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:03.927301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a725c2-6bcd-4a34-aba7-31b842b81e5e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:03.935091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 184/373] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:03.936660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a725c2-6bcd-4a34-aba7-31b842b81e5e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:03.994231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:04.047696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56739afd-e295-4f71-96ec-e0139ea9387b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:04.090744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5c52-b252-4401-bbd9-8bb7666cdd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:04.091557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5c52-b252-4401-bbd9-8bb7666cdd70 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:04.092103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5c52-b252-4401-bbd9-8bb7666cdd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:04.092484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5c52-b252-4401-bbd9-8bb7666cdd70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:04.094010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a725c2-6bcd-4a34-aba7-31b842b81e5e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:04.133122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:04.134662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:04.135091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:04.135561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:04.136560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] RBAC: Adding query filter params (role.id=3b07ac183dc04a88839d50a4af4f356e, user.id=bf88232496824bb0a46007f87698abfe, scope.system=all) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:04.137224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:04.139820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:04.157259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 185/374] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/role_assignments?user.id=bf88232496824bb0a46007f87698abfe&scope.system=all&role.id=3b07ac183dc04a88839d50a4af4f356e => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:04.159158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:04.187008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5c52-b252-4401-bbd9-8bb7666cdd70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:04.189071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c5c52-b252-4401-bbd9-8bb7666cdd70 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:04.275495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:04.338156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:04.409074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 190/375] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:04.410748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd387ce-7b4f-43fe-bbe5-f6decd9e339c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:04.411915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:04.412943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:04.413872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:04.462946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:04.471392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:04.506873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:04.508352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:04.508620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:04.509068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:04.510818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:04.512887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:04.516676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 186/376] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:04 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:04.518459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:04.626163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 191/377] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:04.626163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:04.780968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a76e0-16fb-458d-97f2-4952ac31044b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:04.816568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:04.820971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:04.839497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0bddd-1d76-4584-a60b-d567772db864 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:04.858866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:04.860536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:04.861020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:04.865816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] PATH_INFO: `/v3/projects/adfb054cdc38413f9503cf43dad1c55e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:04.868579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] RBAC: Authorizing `identity:get_project(project_id=adfb054cdc38413f9503cf43dad1c55e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:04.871380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:04.876223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 187/378] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:04 2022] GET /identity/v3/projects/adfb054cdc38413f9503cf43dad1c55e => generated 344 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:04.876467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:04.925355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:04.927637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:04.928592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:04.929602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:04.932458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:04.935832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:04.940643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 192/379] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:04 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:04.943127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:05.089590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f61eea-1e85-48e7-97af-c6f23e4cc687 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:05.161983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ef8ab-dd68-43be-b6c0-58027422c429 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:05.174709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:05.177113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:05.177695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:05.178238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:05.205080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:05.222357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:05.223854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:05.224151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:05.225015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:05.225831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:05.227130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:05.227618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] PATH_INFO: `/v3/groups/aebd251cf0b84cb8a1015c18e3e6a2b1` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:05.227903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 188/380] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:05.232946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:05.242717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] RBAC: Authorizing `identity:get_group(group_id=aebd251cf0b84cb8a1015c18e3e6a2b1)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:05.247643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:05.247643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 193/381] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:04 2022] GET /identity/v3/groups/aebd251cf0b84cb8a1015c18e3e6a2b1 => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:05.248013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:05.307064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:05.317205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:05.392584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e837156-3d6f-49eb-b779-e37d319772c7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:05.459441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:05.460222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:05.460574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:05.460920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:05.462138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=c3792c49618f4887bc9c629ee78c5173) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:05.462361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:05.464216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:05.468923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721a095-5ca7-4c2e-b58e-75bc9cc5c0a2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:05.472777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 189/382] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:05 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:05.474034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:05.560282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:05.561983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:05.562729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:05.563554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:05.565675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:05.566521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:05.569539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:05.598851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 194/383] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:05.606989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:05.653476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98688e-2caa-4b74-b26a-1fd40bbb4e6f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:05.666426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:05.698646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:05.699521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:05.699911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:05.700256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:05.701216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] RBAC: Adding query filter params (group.id=aebd251cf0b84cb8a1015c18e3e6a2b1, role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=adfb054cdc38413f9503cf43dad1c55e) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:05.701578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:05.703646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:05.714736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 190/384] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:05 2022] GET /identity/v3/role_assignments?group.id=aebd251cf0b84cb8a1015c18e3e6a2b1&scope.project.id=adfb054cdc38413f9503cf43dad1c55e&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:05.816004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:05.855082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c412cea-a85d-45e0-9dc0-b183bba54ad1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:05.935574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:05.937003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:05.937493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:05.938017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:05.942639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:05.945535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:05.949174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 195/385] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:05 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:05.954650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:06.114378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f51e-85ca-49bc-bb4e-facc438f6f3b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:06.161064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3754-53ca-4c72-b557-982e9f477adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:06.161987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3754-53ca-4c72-b557-982e9f477adf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.162624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3754-53ca-4c72-b557-982e9f477adf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.162910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3754-53ca-4c72-b557-982e9f477adf None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.164127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3754-53ca-4c72-b557-982e9f477adf None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:06.165621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3754-53ca-4c72-b557-982e9f477adf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:06.167602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 191/386] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:05 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:06.173926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:06.269491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0f36-1a24-4679-8891-58f27f4bbb01 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.269806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0f36-1a24-4679-8891-58f27f4bbb01 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.270056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0f36-1a24-4679-8891-58f27f4bbb01 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.271771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 192/387] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:06.277341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.277637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.277918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.326512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:06.327814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:06.397555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66850fc5-f3e6-4243-91bc-d99d72ae21c2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:06.445176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:06.466758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80f27-74a5-423f-b047-068d9bb1a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:06.468673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80f27-74a5-423f-b047-068d9bb1a3c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.469446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80f27-74a5-423f-b047-068d9bb1a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.470149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80f27-74a5-423f-b047-068d9bb1a3c8 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05/groups/25ab1e92e6af48008789dbd3556ad54f/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.474079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80f27-74a5-423f-b047-068d9bb1a3c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4844568f86af4cf5bcf73b85db238c05, group_id=25ab1e92e6af48008789dbd3556ad54f, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:06.477111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80f27-74a5-423f-b047-068d9bb1a3c8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:06.503851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 196/388] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 15 22:02:06 2022] PUT /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05/groups/25ab1e92e6af48008789dbd3556ad54f/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:06.506658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f39cd-347b-460d-ba67-8bf80ade8ec6 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.507609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f39cd-347b-460d-ba67-8bf80ade8ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.508422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f39cd-347b-460d-ba67-8bf80ade8ec6 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.511706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 197/389] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:06.519183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.519457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.519925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.522055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 193/390] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:06.544759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:06.546152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:06.559076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:06.560885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:06.639136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 198/391] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:06.665053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:06.816636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8860-6e9b-47d2-aa37-c8c569644be2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:06.847646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aceb4-7a6f-426d-9446-b6011ded7713 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:06.879625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:06.880555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.880983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.881285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.887270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:06.888143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:06.888411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:06.888695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:06.902022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:06.911140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:06.913268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:06.914837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 199/392] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:06.916102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:06.919673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:06.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:06.926922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:06.930015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 194/393] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:06.932062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:06.937545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.033759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:07.072120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bd10d-a142-4082-9427-5242283ea26c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:07.156412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:07.157208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:07.157496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:07.157803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:07.158582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:07.158890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:07.160302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:07.187326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 200/394] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:07.194421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.200701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8544-0ac7-434d-81f5-756eafb48cf5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:07.257776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:07.259160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:07.259464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:07.259742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:07.260506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:07.260970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:07.263980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:07.278840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 195/395] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:02:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:07.284695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.315490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:07.356148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7f1dc-c6e8-46bb-9d3f-6714e6a2036a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:07.397664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:07.398939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:07.399490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:07.400006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:07.401528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:07.403310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:07.405891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 201/396] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:07 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:07.411396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.555311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:07.573358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92053477-01ab-4db4-958d-e879cfbd891d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:07.671619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe253-1d79-49aa-b92e-1aafadfdad3c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:07.679921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:07.681449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:07.681944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:07.682438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:07.690301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:07.691812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:07.693952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 196/397] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:07 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:07.699525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.762057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:07.762952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:07.763233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:07.763508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:07.765577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:07.767340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:07.769448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 202/398] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:07 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:07.776325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.786530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:07.882347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e21e30-a7b1-4574-8d6e-475a16c48d3e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:07.964245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:07.964992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:07.965273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:07.965584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:07.967132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:07.968732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:07.972689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 197/399] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:07 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:07.979342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:07.999259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56aeb6-27e0-4b6d-b0bd-9138de2db1e0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:08.053814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:08.076336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47214bce-dafe-4dcc-9602-5b78c43ba7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:08.077268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214bce-dafe-4dcc-9602-5b78c43ba7ed None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:08.077573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214bce-dafe-4dcc-9602-5b78c43ba7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:08.077854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47214bce-dafe-4dcc-9602-5b78c43ba7ed None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05/groups/25ab1e92e6af48008789dbd3556ad54f/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:08.081313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47214bce-dafe-4dcc-9602-5b78c43ba7ed None admin] RBAC: Authorizing `identity:create_grant(project_id=4844568f86af4cf5bcf73b85db238c05, group_id=25ab1e92e6af48008789dbd3556ad54f, role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:08.083166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47214bce-dafe-4dcc-9602-5b78c43ba7ed None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:08.104197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 203/400] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 15 22:02:07 2022] PUT /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05/groups/25ab1e92e6af48008789dbd3556ad54f/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:08.161386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9cfd-a719-4a15-9de4-8cb83286c35a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:08.184039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839e83-84fe-4f65-a05c-ce3e05808611 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:08.184451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839e83-84fe-4f65-a05c-ce3e05808611 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:08.184727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839e83-84fe-4f65-a05c-ce3e05808611 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:08.191904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 204/401] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:08.194159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:08.194451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:08.194733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:08.202064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516833c7-0d80-468e-aab3-283010577ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:08.203124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516833c7-0d80-468e-aab3-283010577ace None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:08.203279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516833c7-0d80-468e-aab3-283010577ace None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:08.203646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516833c7-0d80-468e-aab3-283010577ace None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173/groups/25ab1e92e6af48008789dbd3556ad54f/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:08.209853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516833c7-0d80-468e-aab3-283010577ace None admin] RBAC: Authorizing `identity:create_grant(project_id=c3792c49618f4887bc9c629ee78c5173, group_id=25ab1e92e6af48008789dbd3556ad54f, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:08.211396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516833c7-0d80-468e-aab3-283010577ace None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:08.227728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:08.228887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:08.238403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 198/402] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 15 22:02:07 2022] PUT /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173/groups/25ab1e92e6af48008789dbd3556ad54f/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:08.351204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:08.366759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 205/403] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:08.390519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516833c7-0d80-468e-aab3-283010577ace None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:08.530764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516833c7-0d80-468e-aab3-283010577ace None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:08.532610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:08.575025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:08.575869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:08.576146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:08.576421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:08.587921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:08.596471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:08.597581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:08.598974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 199/404] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:02:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:08.607204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:08.781814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ae3e7-79b0-429d-afaa-d44d5f0640e7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:08.840651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:08.841517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:08.841803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:08.842099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:08.843019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:08.843334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:08.844782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:08.858517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 206/405] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:08.864785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:09.049564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121e9eb-f276-4fc9-8299-98641e3b018b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:09.103308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9f208-e04e-4af8-a2b6-c75b1e83d51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:09.104431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9f208-e04e-4af8-a2b6-c75b1e83d51a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.104794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9f208-e04e-4af8-a2b6-c75b1e83d51a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.105115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9f208-e04e-4af8-a2b6-c75b1e83d51a None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.106593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9f208-e04e-4af8-a2b6-c75b1e83d51a None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:09.108633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9f208-e04e-4af8-a2b6-c75b1e83d51a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:09.111098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 200/406] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:08 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:09.117454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:09.263159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:09.338111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ec6a7-db40-426a-9f31-3474566d4900 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:09.373310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157539-b6e0-4cfd-8c3e-47bff38e6a6b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.373896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157539-b6e0-4cfd-8c3e-47bff38e6a6b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.373896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64157539-b6e0-4cfd-8c3e-47bff38e6a6b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.375568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 201/407] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:02:09.383886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.383886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.383886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.403663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:09.405228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:09.418841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:09.419736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.420018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.420291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.424525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:09.426048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:09.430900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 207/408] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:09 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:09.434940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:09.437937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:09.538765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 202/409] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:09.589735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:09.638153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab4324-1575-4706-91ab-24b64cc0a3d1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:09.714635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:09.733906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6045e1-9ee4-4663-86dc-d6bea1f32344 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:09.746942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0e048-6002-4829-b8c1-f9e3beae1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:09.748255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0e048-6002-4829-b8c1-f9e3beae1f65 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.748605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0e048-6002-4829-b8c1-f9e3beae1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.748974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0e048-6002-4829-b8c1-f9e3beae1f65 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173/groups/25ab1e92e6af48008789dbd3556ad54f/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.761622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0e048-6002-4829-b8c1-f9e3beae1f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3792c49618f4887bc9c629ee78c5173, group_id=25ab1e92e6af48008789dbd3556ad54f, role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:09.763205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0e048-6002-4829-b8c1-f9e3beae1f65 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:09.779777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:09.780105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 208/410] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 15 22:02:09 2022] PUT /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173/groups/25ab1e92e6af48008789dbd3556ad54f/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:09.781042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.781613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.781892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5758-7295-4f74-aa82-9aeeda8f3a1c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.782216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.782322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5758-7295-4f74-aa82-9aeeda8f3a1c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.782554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5758-7295-4f74-aa82-9aeeda8f3a1c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.784189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 209/411] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:09.790613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:09.790901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:09.791245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:09.799391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:09.808754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:09.809912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:09.810888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:09.812697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:09.814005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 203/412] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:09.817439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:09.820257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:09.836855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:09.917441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 210/413] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:09.951837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:10.067085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bff0c8-71c2-4a60-9706-0a17dcb2b5af None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:10.134264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162667-9885-4091-b04c-bcf39c7eb2d9 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:10.139450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:10.140586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:10.141175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:10.141725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:10.143217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] RBAC: Adding query filter params (name=member) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:10.143780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:10.146387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:10.167044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 204/414] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:10.167809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:10.175191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:10.238197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:10.239426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:10.239426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:10.239704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:10.282441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:10.295809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:10.299532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:10.300680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:10.302072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:10.303069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 211/415] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:10.311789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:10.386585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe31501-6254-47da-8f94-cee3752f9f07 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:10.510475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de19712-e388-494c-baa7-e291d59669af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:10.511472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de19712-e388-494c-baa7-e291d59669af None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:10.511941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de19712-e388-494c-baa7-e291d59669af None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:10.512416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de19712-e388-494c-baa7-e291d59669af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:10.543410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f7d1-8a0b-4885-abd4-828495927ede None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:10.630115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:10.631251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:10.631872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:10.632615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:10.633943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:10.634487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:10.636187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:10.659754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 212/416] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:10.662536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de19712-e388-494c-baa7-e291d59669af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:10.664044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de19712-e388-494c-baa7-e291d59669af None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:10.665875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:10.778636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:10.796689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:10.841034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 205/417] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:10.849733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de19712-e388-494c-baa7-e291d59669af None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:10.935129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd9f6f-89d3-4b37-a59d-c63950b0c839 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:10.982295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de19712-e388-494c-baa7-e291d59669af None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:11.037864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.039296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.040216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.041304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.043487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:11.045687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:11.048250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 206/418] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:10 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:11.050342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.051642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.052185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.052705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] PATH_INFO: `/v3/groups/aebd251cf0b84cb8a1015c18e3e6a2b1` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.054444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] RBAC: Authorizing `identity:get_group(group_id=aebd251cf0b84cb8a1015c18e3e6a2b1)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:11.056257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:11.057488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:11.059914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 213/419] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:10 2022] GET /identity/v3/groups/aebd251cf0b84cb8a1015c18e3e6a2b1 => generated 229 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:11.068616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:11.127342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:11.218874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392448b-6cec-494a-a6d2-32754b7055b9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:11.323337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4b39b-6800-4a74-a19b-010ba24435a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.324682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4b39b-6800-4a74-a19b-010ba24435a4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.325476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4b39b-6800-4a74-a19b-010ba24435a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.326073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4b39b-6800-4a74-a19b-010ba24435a4 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.328411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4b39b-6800-4a74-a19b-010ba24435a4 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:11.330673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4b39b-6800-4a74-a19b-010ba24435a4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:11.331132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58174a91-a190-425d-b285-701a281fe7a1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:11.333842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 207/420] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:11 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:11.334056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:11.336764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649979d9-674f-4772-81ae-4f31f89de548 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.337340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649979d9-674f-4772-81ae-4f31f89de548 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.337905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649979d9-674f-4772-81ae-4f31f89de548 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.340378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 208/421] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:11.341591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649979d9-674f-4772-81ae-4f31f89de548 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:11.386578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6991988-d4ad-4b07-a2cf-6e8ee2fe7c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.388079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991988-d4ad-4b07-a2cf-6e8ee2fe7c10 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.388557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991988-d4ad-4b07-a2cf-6e8ee2fe7c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.388934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6991988-d4ad-4b07-a2cf-6e8ee2fe7c10 None admin] PATH_INFO: `/v3/projects/adfb054cdc38413f9503cf43dad1c55e` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.393495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6991988-d4ad-4b07-a2cf-6e8ee2fe7c10 None admin] RBAC: Authorizing `identity:get_project(project_id=adfb054cdc38413f9503cf43dad1c55e)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:11.395870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6991988-d4ad-4b07-a2cf-6e8ee2fe7c10 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:11.403348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 214/422] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:11 2022] GET /identity/v3/projects/adfb054cdc38413f9503cf43dad1c55e => generated 344 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:11.403348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0559e-b8a9-4263-a6a4-7ba5a5ae7a6f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.403348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0559e-b8a9-4263-a6a4-7ba5a5ae7a6f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.403348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0559e-b8a9-4263-a6a4-7ba5a5ae7a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.428590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-21e0559e-b8a9-4263-a6a4-7ba5a5ae7a6f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:11.437318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-21e0559e-b8a9-4263-a6a4-7ba5a5ae7a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:11.484966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649979d9-674f-4772-81ae-4f31f89de548 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:11.495137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:11.538494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.539172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.539451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.539727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.540568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=4844568f86af4cf5bcf73b85db238c05) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:11.540878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:11.542361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4e680-8380-4899-8a32-4df8a3366b9e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:11.549021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 209/423] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:11 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:11.550381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3164-7245-4d12-9eaf-fee3962b835e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.550660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3164-7245-4d12-9eaf-fee3962b835e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.550933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3164-7245-4d12-9eaf-fee3962b835e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.553381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 210/424] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:11.553381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3164-7245-4d12-9eaf-fee3962b835e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:11.577442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 215/425] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:11.577442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.577442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.577442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.606520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:11.608199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:11.705768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 216/426] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:11.708338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:11.756398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3164-7245-4d12-9eaf-fee3962b835e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:11.783951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:11.814427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.814427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.814427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.814427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] PATH_INFO: `/v3/projects/adfb054cdc38413f9503cf43dad1c55e/groups/aebd251cf0b84cb8a1015c18e3e6a2b1/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.816091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=adfb054cdc38413f9503cf43dad1c55e, group_id=aebd251cf0b84cb8a1015c18e3e6a2b1, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:11.817485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:11.839495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 211/427] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jun 15 22:02:11 2022] PUT /identity/v3/projects/adfb054cdc38413f9503cf43dad1c55e/groups/aebd251cf0b84cb8a1015c18e3e6a2b1/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:11.840860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:11.892213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f50f0-9272-4e81-98b6-86ae7c8a0264 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:11.903694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:11.957707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:11.959446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:11.960107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:11.960866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:11.988234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:12.007773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:12.009569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 22:02:12.011147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:12.015821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 217/428] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:12.026987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29168f-625a-4b91-95bd-aef9cd26bfd0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:12.032984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:12.088067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:12.088908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.089221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.089476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.106480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:12.116297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:12.117752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:12.118586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:12.121484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 212/429] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:02:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:12.124281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:12.210780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:12.225452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721788b-6582-4ce1-94ec-f0bc8cf794c2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:12.287054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:12.288067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:12.289647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.290111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.290521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.291468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] RBAC: Adding query filter params (name=member) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:12.291949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:12.293610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:12.300816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb348-83a4-4c8e-a8aa-23024ff22bd7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:12.308838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 218/430] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:12.310596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:12.344268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:12.345070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.345540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.345876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.346897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:12.347212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:12.348914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:12.363900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 213/431] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:12.366186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:12.431516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae97b-6016-489c-80a6-03cfeeaf0a45 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:12.471760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:12.472840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.473347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.473817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.508168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590cada-1360-46bd-a953-b9a1f327227b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:12.519160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:12.571211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:12.573424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:12.574857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3c0fb-7dbb-4b85-86ae-e68f9ba74f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:12.575856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c0fb-7dbb-4b85-86ae-e68f9ba74f5f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.576141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c0fb-7dbb-4b85-86ae-e68f9ba74f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.576417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c0fb-7dbb-4b85-86ae-e68f9ba74f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.629109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:12.709589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c0fb-7dbb-4b85-86ae-e68f9ba74f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:12.712000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c0fb-7dbb-4b85-86ae-e68f9ba74f5f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:12.732592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 219/432] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:02:12.738595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:12.823002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:12.890261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b4f55-5890-4dd2-a639-6c711dde9fbe None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:12.901412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 214/433] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:12.902685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc121f-b0a1-4185-9060-83d75ea35b25 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.903010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc121f-b0a1-4185-9060-83d75ea35b25 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.903260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc121f-b0a1-4185-9060-83d75ea35b25 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.904981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 215/434] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:12.909901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc121f-b0a1-4185-9060-83d75ea35b25 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:12.938035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2cb5-81fa-44bb-ab39-0a727f3dd075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:12.939001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2cb5-81fa-44bb-ab39-0a727f3dd075 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.939321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2cb5-81fa-44bb-ab39-0a727f3dd075 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.939549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2cb5-81fa-44bb-ab39-0a727f3dd075 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.940759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2cb5-81fa-44bb-ab39-0a727f3dd075 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:12.942272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2cb5-81fa-44bb-ab39-0a727f3dd075 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:12.944154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 220/435] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:12 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:12.949761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:12.950052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:12.950288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:12.968210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:12.969514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:12.974465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:13.039878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc121f-b0a1-4185-9060-83d75ea35b25 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.056668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 221/436] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:13.057808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.077855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.079218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.079717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.080154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] PATH_INFO: `/v3/projects/4844568f86af4cf5bcf73b85db238c05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.081804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] RBAC: Authorizing `identity:get_project(project_id=4844568f86af4cf5bcf73b85db238c05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.083797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:13.091722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 216/437] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:12 2022] GET /identity/v3/projects/4844568f86af4cf5bcf73b85db238c05 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:13.092980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.133829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:13.206172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9048305-dc52-4b6a-9ff1-beb6a2c8e889 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.224127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623253f-b4e4-42cf-87e2-f556f9acce8c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.249981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:13.254372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.255873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.256318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.256722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.258931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.261446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:13.263763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 222/438] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:13.264904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.274449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.275669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.276187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.276651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.290666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:13.301873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:13.303659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:13.304983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 217/439] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:13.305909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.401846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1e5e6-855d-49cb-9a9f-4c7a27699eeb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.433020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:13.443223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623ee3-59fc-4854-a28e-98701f1bf9fb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.454007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.455364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.455788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.456292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.458492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.460581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:13.462509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 223/440] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:13.463356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.494078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.495053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.495496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.495911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.497079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=b00b4e9815664c168438c3cc4e734a6f, scope.project.id=c3792c49618f4887bc9c629ee78c5173) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:13.497724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.500314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:13.513672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 218/441] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=b00b4e9815664c168438c3cc4e734a6f => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:13.521503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.596161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:13.597505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0042b-3db4-4229-94a1-cb8e75114941 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.639017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.639717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.640043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.640270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.641375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:13.641858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.643444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:13.654033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 224/442] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:13.660315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:13.688050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed09bf-6725-45a4-8f08-cfb7fe6d6caa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.738874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.739378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.739653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.739927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.740810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=4844568f86af4cf5bcf73b85db238c05) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:13.741109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.742626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:13.750957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 219/443] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=4844568f86af4cf5bcf73b85db238c05&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:13.751140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:13.833624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf112d-0b77-4ecd-8969-81ea3e31f308 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:13.897145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2592e-15c9-4d0f-95ab-c06cd7af0fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:13.898130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2592e-15c9-4d0f-95ab-c06cd7af0fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:13.898691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2592e-15c9-4d0f-95ab-c06cd7af0fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:13.898691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2592e-15c9-4d0f-95ab-c06cd7af0fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:13.996431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2592e-15c9-4d0f-95ab-c06cd7af0fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:13.999032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2592e-15c9-4d0f-95ab-c06cd7af0fd1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:14.077467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:14.173969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 225/444] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:14.176357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:14.340156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1cb2a-a9b6-4d62-8cbc-ee22360fb2b0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:14.357069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645d57-6956-4bd1-a33e-b86351ca12a9 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.357394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645d57-6956-4bd1-a33e-b86351ca12a9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.357680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645d57-6956-4bd1-a33e-b86351ca12a9 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.358150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:14.359479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 226/445] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:02:14.366034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.366735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.366735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.387617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:14.389928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:14.391053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:14.392764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.393043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.393315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] PATH_INFO: `/v3/projects/c3792c49618f4887bc9c629ee78c5173` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.394611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] RBAC: Authorizing `identity:get_project(project_id=c3792c49618f4887bc9c629ee78c5173)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:14.396091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:14.398047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 220/446] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:14 2022] GET /identity/v3/projects/c3792c49618f4887bc9c629ee78c5173 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:14.403441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:14.486789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 227/447] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:14.511493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:14.544523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52854d-a752-4470-8cea-e975f69bd370 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:14.592751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:14.593557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.593834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.594306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] PATH_INFO: `/v3/groups/25ab1e92e6af48008789dbd3556ad54f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.596238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] RBAC: Authorizing `identity:get_group(group_id=25ab1e92e6af48008789dbd3556ad54f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:14.597647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:14.599317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 221/448] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:14 2022] GET /identity/v3/groups/25ab1e92e6af48008789dbd3556ad54f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:14.605519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:14.610515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:14.638641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ec6d3-adda-4571-b6e2-5e7a56d10ccb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:14.656061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:14.681230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:14.682215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.682493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.682765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.695082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:14.702922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:14.704067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:14.704962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 228/449] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:14.710865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:14.723572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac554cea-315a-4367-92d8-4aaa7202944e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:14.768744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:14.769526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.769806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.770080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.770923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] RBAC: Adding query filter params (group.id=25ab1e92e6af48008789dbd3556ad54f, role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=c3792c49618f4887bc9c629ee78c5173) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:14.771231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:14.772684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:14.779448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 222/450] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:14 2022] GET /identity/v3/role_assignments?group.id=25ab1e92e6af48008789dbd3556ad54f&scope.project.id=c3792c49618f4887bc9c629ee78c5173&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:14.861585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce444b-8156-4f17-bc40-028fe920436f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:14.925008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:14.925750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:14.926032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:14.926317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:14.927095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:14.927531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:14.928836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:14.939058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 229/451] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:14.945164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:15.070302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acf3ff-e4e8-4a03-b6e1-056f3206fa5f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:15.080580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:15.117809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:15.118396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:15.118675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:15.118950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:15.215439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:15.217155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:15.333810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 223/452] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:15.339660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:15.342670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:15.464347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfae5f7-9a57-458f-b144-3a2a565abe40 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:15.500093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:15.501041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:15.501363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:15.501629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] PATH_INFO: `/v3/projects/adfb054cdc38413f9503cf43dad1c55e` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:15.502893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] RBAC: Authorizing `identity:get_project(project_id=adfb054cdc38413f9503cf43dad1c55e)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:15.504354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:15.506126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 230/453] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:02:15 2022] GET /identity/v3/projects/adfb054cdc38413f9503cf43dad1c55e => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:15.512252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:15.525654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:15.631481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aaace-5690-4fb9-a5b2-573a1256c23a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:15.671891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda1929-3010-4aab-94ce-c44ca2984ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:15.672942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda1929-3010-4aab-94ce-c44ca2984ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:15.673226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda1929-3010-4aab-94ce-c44ca2984ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:15.673537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda1929-3010-4aab-94ce-c44ca2984ee0 None admin] PATH_INFO: `/v3/groups/aebd251cf0b84cb8a1015c18e3e6a2b1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:15.674881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda1929-3010-4aab-94ce-c44ca2984ee0 None admin] RBAC: Authorizing `identity:get_group(group_id=aebd251cf0b84cb8a1015c18e3e6a2b1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:15.676339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda1929-3010-4aab-94ce-c44ca2984ee0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:15.678039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 224/454] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jun 15 22:02:15 2022] GET /identity/v3/groups/aebd251cf0b84cb8a1015c18e3e6a2b1 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:15.684945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:15.765025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:15.802611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04961ba-8d03-4f9d-8529-4427085c9782 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:15.848768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:15.849460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:15.849738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:15.850007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:15.850855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] RBAC: Adding query filter params (group.id=aebd251cf0b84cb8a1015c18e3e6a2b1, role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=adfb054cdc38413f9503cf43dad1c55e) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:15.851153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:15.852645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a7a7d-917d-4962-9126-d2223858d093 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:15.859101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 231/455] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jun 15 22:02:15 2022] GET /identity/v3/role_assignments?group.id=aebd251cf0b84cb8a1015c18e3e6a2b1&scope.project.id=adfb054cdc38413f9503cf43dad1c55e&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:18.761412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039d6a-2ef0-4fa3-896a-0087b147e83e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:18.761412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039d6a-2ef0-4fa3-896a-0087b147e83e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:18.761412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039d6a-2ef0-4fa3-896a-0087b147e83e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:18.762376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 225/456] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:18.776730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25fe4-57f7-46cd-b7a7-450146a3483f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:18.777635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25fe4-57f7-46cd-b7a7-450146a3483f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:18.778051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a25fe4-57f7-46cd-b7a7-450146a3483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:18.797209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f7a25fe4-57f7-46cd-b7a7-450146a3483f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:18.803090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f7a25fe4-57f7-46cd-b7a7-450146a3483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:18.894476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 232/457] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:18.953815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039d6a-2ef0-4fa3-896a-0087b147e83e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.015529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c401a-784b-4ca2-bb8c-68ba099c7ec3 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.016424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c401a-784b-4ca2-bb8c-68ba099c7ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.017128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c401a-784b-4ca2-bb8c-68ba099c7ec3 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.020111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 233/458] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:19.026983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.027773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.028425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.051008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:19.052533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:19.105799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:19.139126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039d6a-2ef0-4fa3-896a-0087b147e83e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:19.193785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:19.194225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:19.195685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.196128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.196811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.217226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 234/459] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:19.227088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:19.229164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:19.262371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:19.281081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:19.283148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:19.284792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:19.284792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:19.284792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:19.284792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:19.290486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 226/460] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:19.296234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.388542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ee7e2-6bca-4bb4-a8bd-7459d7adc889 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:19.431089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b4074-8f59-425e-91f2-3675128ec80f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:19.432866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:19.434148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.434671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.435265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.452062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:19.454943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:19.466884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:19.478090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:19.479159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.479581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.480112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.480998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:19.481494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-1cde0f02-dfe2-435d-9c45-b800d6e697a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:19.482601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:19.483605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:19.484623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:19.484623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:19.484623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:19.484623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:19.485793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 235/461] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:19.486255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d32795-66a1-4e0e-8be6-dcf707e45fa0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:19.487890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243899a4-ffd9-444f-97a7-429e98ed02a5 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.488351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243899a4-ffd9-444f-97a7-429e98ed02a5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.489125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243899a4-ffd9-444f-97a7-429e98ed02a5 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.491302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 236/462] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:19.492347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243899a4-ffd9-444f-97a7-429e98ed02a5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.510337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 227/463] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:19.511885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.512171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.512445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.530646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:19.532800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:19.548474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:19.615583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243899a4-ffd9-444f-97a7-429e98ed02a5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:19.621667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 228/464] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:19.622790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.678685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:19.679653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.680074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.681121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.682098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:19.682726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:19.684533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:19.701867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 237/465] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:19.703047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.805087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15283c-e24e-4aa7-bfc8-075fb8f542a7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:19.823705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f55d3-c415-4182-b67c-b08676648542 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:19.829132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:19.836009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:19.855401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:19.856545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.857011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.857781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.858738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:19.861047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:19.883126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:19.883975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.884269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.884545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.893604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 229/466] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:02:19 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:19.893604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:19.910393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:19.912451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b0487cdb-7ced-467e-aa53-bc88daf65227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:19.936764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:19.938620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:19.940257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:19.940257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:19.940257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:19.940257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:19.940257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 238/467] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:19.940564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19fc0-290e-4ff8-b548-810568a9331b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:19.940564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19fc0-290e-4ff8-b548-810568a9331b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:19.941074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19fc0-290e-4ff8-b548-810568a9331b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:19.944435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 239/468] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:19.949463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19fc0-290e-4ff8-b548-810568a9331b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:20.052702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f2e1-7c70-437b-b002-376790344024 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:20.108175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370921-e7e8-428f-9284-dbe4b9e1e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:20.108824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370921-e7e8-428f-9284-dbe4b9e1e4a0 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.109244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370921-e7e8-428f-9284-dbe4b9e1e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.109356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19fc0-290e-4ff8-b548-810568a9331b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:20.109642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370921-e7e8-428f-9284-dbe4b9e1e4a0 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.111791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03370921-e7e8-428f-9284-dbe4b9e1e4a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:20.114792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03370921-e7e8-428f-9284-dbe4b9e1e4a0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:20.147846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 230/469] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:02:19 2022] POST /identity/v3/users => generated 246 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:20.149615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec4dc0-b7d9-4438-878e-7f66fa150389 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.149913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec4dc0-b7d9-4438-878e-7f66fa150389 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.150332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec4dc0-b7d9-4438-878e-7f66fa150389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.174268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-70ec4dc0-b7d9-4438-878e-7f66fa150389 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:20.175911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-70ec4dc0-b7d9-4438-878e-7f66fa150389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:20.176897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:20.178351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.179140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.179954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.181063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:20.181501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:20.183264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d0a03-b5dd-4989-b18f-5b1727d2e82d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:20.209263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 240/470] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:20.211971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18947eb-f019-4611-af1e-c944f4a5d1cc None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.212546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18947eb-f019-4611-af1e-c944f4a5d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.213052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18947eb-f019-4611-af1e-c944f4a5d1cc None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.213868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:20.216319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 241/471] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:20.218149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18947eb-f019-4611-af1e-c944f4a5d1cc None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:20.258649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:20.297948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 231/472] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:20.299588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254fecd-3384-419f-96fb-66f137051930 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.299882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254fecd-3384-419f-96fb-66f137051930 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.300212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254fecd-3384-419f-96fb-66f137051930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.331697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3254fecd-3384-419f-96fb-66f137051930 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:20.333134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3254fecd-3384-419f-96fb-66f137051930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:20.377371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18947eb-f019-4611-af1e-c944f4a5d1cc None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:20.434445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:20.435218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.435532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.436428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.436593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:20.438325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:20.460113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 232/473] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:20.461268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254fecd-3384-419f-96fb-66f137051930 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:20.478746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 242/474] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:02:20 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:02:20.492082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:20.641757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:20.663309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254fecd-3384-419f-96fb-66f137051930 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:20.689791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:20.747928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:20.748746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.749028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.749301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.750652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ac11d-46ef-4eb4-9b5a-d44d4d2947c7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:20.766208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:20.767710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:20.792916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:20.794006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:20.794831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:20.794831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:20.794831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:20.794831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:20.794831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 233/475] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:20.808650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:20.810034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:20.810472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:20.811455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:20.811958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:20.813471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:20.815800 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:20.828753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.sql.core [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 22:02:20.828753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 22:02:20.828753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [parameters: {'id': 'e6152e25fd0f4e448210796614307b66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 22:02:20.828753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80294) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application conn.query(q) Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application result.read() Jun 15 22:02:20.846479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return ref.to_dict() Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 22:02:20.847411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application next(self.gen) Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application yield resource Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application next(self.gen) Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise self.value Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application session.commit() Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 22:02:20.848306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self.session.flush() Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application compat.raise_( Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 22:02:20.849119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 22:02:20.851209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application conn.query(q) Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application result.read() Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 22:02:20.852057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [parameters: {'id': 'e6152e25fd0f4e448210796614307b66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:20.854044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 22:02:20.855963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:20.858112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 243/476] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 15 22:02:20 2022] POST /identity/v3/roles => generated 144 bytes in 357 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:20.858112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:20.964071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d37a4-13df-4a4f-b5db-93c19abe9a91 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:20.989575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1de69-2b28-4fc9-b910-cc5bec25a997 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:21.011920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:21.012994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:21.013518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:21.013981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:21.014904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:21.015398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:21.017845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:21.032062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 234/477] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:21.038893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:21.039925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:21.040787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:21.041091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:21.041453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:21.045877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:21.063001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:21.074391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:21.083747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:21.084870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 22:02:21.085677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:21.089167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 244/478] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:02:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:21.094576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:21.178600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216fe7a-27d7-41bf-bdc1-86447623b62d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:21.231598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e16dc-63cf-4c27-be59-535287c46c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:21.233453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e16dc-63cf-4c27-be59-535287c46c9e None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:21.233737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e16dc-63cf-4c27-be59-535287c46c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:21.234005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e16dc-63cf-4c27-be59-535287c46c9e None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:21.235258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e16dc-63cf-4c27-be59-535287c46c9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:21.236736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e16dc-63cf-4c27-be59-535287c46c9e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:21.286763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 235/479] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:02:21 2022] POST /identity/v3/users => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:02:21.340461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844d7dd-e90a-4990-9fd6-93c488b95f9f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:21.428960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:21.430104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:21.430595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:21.431151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:21.432176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:21.432692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:21.434440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb3a2d-84ca-4f11-83e5-acc93c60d85b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:21.445713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 245/480] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:22.606397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4f8e-6aac-4034-868e-f83c5027bfc0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:22.606904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4f8e-6aac-4034-868e-f83c5027bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:22.606904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4f8e-6aac-4034-868e-f83c5027bfc0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:22.608621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 236/481] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:22.615470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c8f0-827f-47b4-9be1-bf2af4012787 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:22.616036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c8f0-827f-47b4-9be1-bf2af4012787 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:22.616036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5c8f0-827f-47b4-9be1-bf2af4012787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:22.638860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-aee5c8f0-827f-47b4-9be1-bf2af4012787 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:22.640067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aee5c8f0-827f-47b4-9be1-bf2af4012787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:22.739645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:22.759614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 246/482] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:22.799201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf4f8e-6aac-4034-868e-f83c5027bfc0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:22.911621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:23.015914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf4f8e-6aac-4034-868e-f83c5027bfc0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:23.040083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fe51-3950-451a-b326-67b7066e3c3b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.040511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fe51-3950-451a-b326-67b7066e3c3b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.040931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29fe51-3950-451a-b326-67b7066e3c3b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.043652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 247/483] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:23.049905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.050342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.050781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.096688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:23.099674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:23.124548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:23.125541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.125828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.126105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.156632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:23.173779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:23.175228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:23.176504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:23.181646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 237/484] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:23.190147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:23.280888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 248/485] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:23.305364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:23.397366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166657c-8214-477c-ac80-a253116a1213 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:23.441808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:23.472744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:23.473456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.473738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.474008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.474769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:23.475077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:23.476481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:23.505863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 238/486] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:23.510370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:23.543615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41d4a1-9cd0-492b-8cfe-452787382760 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:23.579055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:23.593922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:23.595250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.595724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.596209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.607353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:23.615614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:23.616967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:23.617783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:23.620560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 249/487] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:23.626539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:23.646628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e18996-ce59-47e9-9f4b-08675fc1204a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:23.705360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:23.706185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.706476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.706754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.731960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:23.733470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:23.751311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a931-383f-4303-b2d7-4a796cd80186 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6114f5a7-0ac4-4549-8ec2-530633b21caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:23.767486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:23.768390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:23.769217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:23.769217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:23.769217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:23.769217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:23.769217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 239/488] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:23.770930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627359df-784d-4068-9f24-cc022e654218 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.771211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627359df-784d-4068-9f24-cc022e654218 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.771481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627359df-784d-4068-9f24-cc022e654218 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.772986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 240/489] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:23.774281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627359df-784d-4068-9f24-cc022e654218 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:23.798930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:23.799880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.800161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.800437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.801205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:23.801561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:23.802959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad190-6090-4232-a61f-09476345da10 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:23.811305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:23.820285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 250/490] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:23.826325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.827042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.827326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.844791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:23.845966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:23.889130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:23.926909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627359df-784d-4068-9f24-cc022e654218 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:23.943357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 251/491] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:23.944628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:23.985249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:23.985985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:23.986266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:23.986539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:23.987330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:23.987738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:23.989300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.005858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 241/492] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:24.006801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.096252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66acc-900a-479f-b820-6dfc7c8e99bd None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.130476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.131288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.131568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.131841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.139586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:24.143693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.145596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.153198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33901875-db39-4769-a8ae-13a2024af374 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:24.174662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:24.175723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:24.176704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:24.176704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:24.176704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:24.176704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:24.176957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 252/493] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:24.178395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.205525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed1e92-9aa5-44c6-8b07-8bbdcb4d62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.206333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1e92-9aa5-44c6-8b07-8bbdcb4d62ec None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.206605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1e92-9aa5-44c6-8b07-8bbdcb4d62ec None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.206877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed1e92-9aa5-44c6-8b07-8bbdcb4d62ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.217924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed1e92-9aa5-44c6-8b07-8bbdcb4d62ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-06ed1e92-9aa5-44c6-8b07-8bbdcb4d62ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:24.225843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:24.226764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 242/494] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:24.232713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fdc4-bc60-4216-a05e-417168168ba7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.237219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fdc4-bc60-4216-a05e-417168168ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.237219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fdc4-bc60-4216-a05e-417168168ba7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.237219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 243/495] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:24.237219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128fdc4-bc60-4216-a05e-417168168ba7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.241162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:24.325654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2940c0b-9145-4850-94dd-ce053e7de2c7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.357255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128fdc4-bc60-4216-a05e-417168168ba7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.361297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.362136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.362417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.362692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.370154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.371737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:24.390318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:24.391418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:24.392522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 253/496] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:24.393096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.411765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.412939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.413287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.413677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.414492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:24.414864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.416384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357de22-e28c-49dd-8f0b-c69200c1bf89 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.432199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 244/497] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:24.433938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.434426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.434861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.454511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:24.455731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:24.470731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:24.499472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:24.516914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394436a1-d801-4aa1-a307-5837202eac76 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.533424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 245/498] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:24.534289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.552476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.553160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.553511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.559121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.559979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:24.560262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.561721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.571297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 254/499] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:24.572324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.636639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a29f8-31f5-45d5-9f40-8c1b3a40c66a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.670797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.671462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.671736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.672052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.672897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:24.673199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.674683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e67d8f-f281-4761-9e2b-788cf58c65f0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.676381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18cde3-b1b4-4494-abb7-c1cef6e09194 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.708666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:24.713348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.713669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 246/500] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:24.714020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.714306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.714584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.715062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30079f1-2c38-40d5-828f-5d777473188a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.715454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30079f1-2c38-40d5-828f-5d777473188a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.715737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30079f1-2c38-40d5-828f-5d777473188a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.717386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 247/501] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:24.718538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30079f1-2c38-40d5-828f-5d777473188a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.724194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.725715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:24.740575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:24.741489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:24.742413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 255/502] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:24.743047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.755658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:24.826362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30079f1-2c38-40d5-828f-5d777473188a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.850365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c52250-dde5-4c22-83a6-690988bea3dc None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:24.861915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.862743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.863021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.863290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.874235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.875730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.884521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:24.885305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.885641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.885916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:24.894784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:24.895685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:24.896538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:24.896538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:24.896538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:24.896538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:24.896538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 248/503] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:24.896794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:24.896861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:24.898105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-911149da-aa50-4571-b9e8-aca601cb6547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:24.920182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:24.921149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:24.922625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:24.922625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:24.922625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:24.922625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:24.922625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 256/504] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:24.923092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:24.923376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:24.923653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:24.940178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:24.941418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:24.956849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.000187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.008496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33bba6-e89e-4db7-952a-0b381d142c9a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.016168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 257/505] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:25.017149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.059380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.060087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.060369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.060642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.122043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be7bb7-a48a-4c7d-9848-d137eb675d6b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.133161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.134678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.159945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.160635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.160930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.161183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.162428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:25.162735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.164235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.204713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 258/506] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:25.205686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.222486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.256959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.276383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 249/507] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:25.277162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.313655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0e1c0-08f8-4734-8417-762521f7b4ca None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.349192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.349906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.350196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.350452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.351189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:25.351499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.352916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.364501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 259/508] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:25.365354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.382144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66de7a-7ae3-4286-ac38-49a6b5ba7171 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.420759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.421459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.421738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.422115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.422806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:25.423110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.424486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.436005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 250/509] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:25.436943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.454486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.473139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3558fb0-407b-46e2-8952-0f5839cf473b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.480427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.508590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.509425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.509707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.509982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.520517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:25.528338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:25.529231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:25.530096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 260/510] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:25.530755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.549301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a82e3-e3c8-41b4-b6e3-0959c31332f0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.585659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.586323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.586591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.586857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.638692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada6d1-02d5-4c87-a32b-ba672df5d347 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.660854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.662727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.676842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.677490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.678131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.678411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.678770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.692004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.693528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:25.711550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:25.712976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:25.714451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:25.714451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:25.714451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:25.714451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:25.714451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 261/511] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:25.714451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.735070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.772163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 251/512] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:25.773284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.829438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e777e-89d7-43f9-b034-26fd31da50dc None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.868834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.869558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.869863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.870135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.870851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.872329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.884535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7f7fb-d0d6-40b4-9618-eb4e880035b0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:25.895424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 262/513] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:02:25 2022] POST /identity/v3/users => generated 247 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:25.896327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:25.916776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:25.953489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:25.954807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:25.955239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:25.955686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:25.964934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:25.966492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:25.985026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:25.986188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 252/514] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:25.990490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.017633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.064366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff71fe6-4128-4377-ab11-ca5affee77b2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.106191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.106807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.111294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.111294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.111294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:26.111294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.111294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.120132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac1c99-8069-421d-b4b7-dd814c3a1ad5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.122544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 263/515] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:26.122544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.173841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.175410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.176181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.176743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.178183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:26.178733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.181433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.202436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 253/516] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:26.203796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.243951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.265428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e610ba-4647-4d09-b751-81885a58bf10 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.310010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.310927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.311211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.311488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.315274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.325859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.327506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.332909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ac63c-ad6d-493e-9b1a-b04adbfdcc05 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:26.346313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:26.347280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:26.348147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:26.348147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:26.348147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:26.348147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:26.348147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 264/517] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:26.348437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.374735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.375492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.375780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.376053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.376929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:26.377235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.378724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.402891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 254/518] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:26.402891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.475823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab74ba1-95f8-4501-bd8c-7f1eff6c8132 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.512378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.513198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.513512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.513789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.525884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.527378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.539282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:26.547248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:26.548164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:26.549007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:26.549007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:26.549007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:26.549007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:26.549007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 265/519] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:26.549947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.563443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b83a51-c240-417d-829f-cf66f852bc36 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.597726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.602524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.603788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.604081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.604408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.613201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.614665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:26.630856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:26.631896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:26.632881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:26.633481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 255/520] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:26.634358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.677082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1230e2-d6c7-465e-8c8c-a23566735dde None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.715506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.716145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.716418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.716695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.717462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:26.718411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.719357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.744593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 266/521] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:26.744593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:26.772511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a74e4-b8fb-458a-9b78-42cc7f484b19 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.814073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.814732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.815011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.815282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.838720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.854917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:26.860761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf35606-076f-4adc-ad7c-cb9fdd58e5b0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:26.898133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.899863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.902083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:26.902786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:26.903068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:26.903348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:26.904089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:26.904402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:26.905914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:26.924326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 267/522] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:26.924326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.030255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 256/523] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:27.032079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.040093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd469a2-5c00-4c5e-b5d8-917aad1ada48 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.080151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.080867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.081233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.081441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.082242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:27.082551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.084021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.107655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 268/524] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:27.107655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.114518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:27.131559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:27.183244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15cb82-c422-432f-b74c-1e4ad1dfbf3e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.225083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d47004-5ac0-456a-a840-0c42a0a58642 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.233145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.233997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.234288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.234668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.244131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.245621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:27.263421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:27.264848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 257/525] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:27.265955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.271361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.272199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.272476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.272744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.280873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.283114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:27.299786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:27.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 269/526] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:27.306916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.388108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e905-5b43-441c-8d38-c9d346673566 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.400664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:27.408009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:27.430931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.432149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a6896-0213-4729-b210-b0630fcc7a1f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.432346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.432835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.433388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.446754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.448394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:27.466912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:27.467847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:27.468676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:27.468676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:27.468676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:27.468676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:27.468676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 258/527] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:27.469715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.478559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.479235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.479515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.479788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.480622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=d6a0960c6d4a497fbd2761d46689fdb3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:27.480927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.482436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.489190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 270/528] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/role_assignments?user.id=d6a0960c6d4a497fbd2761d46689fdb3&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:27.490035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.609921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2022dd-d1bb-4b7a-973b-348dd56ce226 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.643899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf5914-5420-4436-a579-a02d3664a684 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.656477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.657607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.658102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.658560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.659551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:27.660006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.661685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.683150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 259/529] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:27.684329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.701450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.702361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.702733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.703179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.704573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:27.704999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.706613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.715308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:27.729215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 271/530] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:27.730342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.733259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:27.805039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ad990-8c56-4d73-8728-e6e57f114ea9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.841126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.842170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.842618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.843030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.843993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:27.844529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.846248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.850343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5435e0-6f5e-4781-801f-a451a4457da0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:27.859949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 260/531] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:27.861172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.896668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:27.896668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:27.896668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:27.896668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:27.897532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=37af776e1e594cf092bdcb7cf4e86379) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:27.898215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:27.899736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:27.913352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 272/532] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/role_assignments?user.id=37af776e1e594cf092bdcb7cf4e86379&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:27.913352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:27.985433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:28.021605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:28.037659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8a888-86ed-4aec-9956-16589e7d3e59 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.058213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f1583-15e0-425b-b043-31cec758dea3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.117888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.119113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.119595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.120086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.131438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:28.133747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:28.135329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55162dc7-e9e3-436e-9b20-3910b9023b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.136264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162dc7-e9e3-436e-9b20-3910b9023b5d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.136735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162dc7-e9e3-436e-9b20-3910b9023b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.137215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55162dc7-e9e3-436e-9b20-3910b9023b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-060b07ef-1709-4959-8008-8d0d2ee5a3f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:28.166029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:28.166940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:28.167755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:28.177034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 273/533] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:28.178575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3843c49-7d37-40d3-821c-5bd22ae64dd9 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.178922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3843c49-7d37-40d3-821c-5bd22ae64dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.179463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3843c49-7d37-40d3-821c-5bd22ae64dd9 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.181232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 274/534] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:28.184569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3843c49-7d37-40d3-821c-5bd22ae64dd9 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:28.253869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55162dc7-e9e3-436e-9b20-3910b9023b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:28.255273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55162dc7-e9e3-436e-9b20-3910b9023b5d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:28.348428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3843c49-7d37-40d3-821c-5bd22ae64dd9 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.367904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:28.388431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:28.398308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 261/535] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:28.399733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.400024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.400301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.401467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.402515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.403039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.403490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.404497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:28.404986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:28.408136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:28.423786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 275/536] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:28.424782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:28.425156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:28.426755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:28.514897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 262/537] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:28.516270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:28.567064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae83471-d7ba-4904-9ecc-08387a96aa6c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.612584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.613673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.613945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.614688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.629137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:28.631370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:28.636678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d878-a711-4ac8-9ed7-aa8cbaed4499 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:28.657862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:28.658772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:28.659677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:28.659677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:28.659677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:28.659677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:28.660405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:28.663235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 276/538] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:28.664438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:28.692762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.693619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.694001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.694377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.695318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=85cfb11b9f0e4b0eb5078ab7a14948ee) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:28.695735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:28.697275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:28.704029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 263/539] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:28 2022] GET /identity/v3/role_assignments?user.id=85cfb11b9f0e4b0eb5078ab7a14948ee&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:28.705201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:28.734148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:28.883863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da5489-a1ce-4d7a-91f8-a331b0d0bbbb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.920002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312eb5f-2650-49ff-8d92-41f829b12893 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:28.927099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.927925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.928208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.928484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.945347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:28.949265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:28.950154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:28.951400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 277/540] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:28.956981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:28.977569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:28.980674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:28.981168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:28.981661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:28.982591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:28.984468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:28.986525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:28.999553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 264/541] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:29.005097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.057187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:29.121280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:29.126326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a45f68-a635-4fcb-9d7a-41649f55f6d6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.189933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.190796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.191319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.191841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.192772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:29.193184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.195131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:29.206125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 278/542] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:29.212615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.259549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ea399-0b75-49d7-99ec-c35043e92d37 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.325492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba22571-7ee6-4211-952c-56573dacf1f7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.348097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.348919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.349202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.349502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.362260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.363163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.363517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.363883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.366082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.367658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:29.376453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.378028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:29.382454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:29.383261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:29.384254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 265/543] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:29.403210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:29.403756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:29.405720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:29.408328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:29.408328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:29.408328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:29.408328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:29.408328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 279/544] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:29.411518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.433733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:29.527628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdec081-3b3c-4ceb-9d79-2dd95c9d2948 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.564996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.565731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.566083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.566361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.567093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:29.567402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.569009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:29.582694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 280/545] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:29.588373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.616857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:29.630609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b226c3d-ed00-4aa7-983c-3a28bb0c9746 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.668662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:29.719817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.720508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.720789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.721064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.721894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:29.722205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.723667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:29.724803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7cce-a63f-45a7-b768-3f5cf0cf7423 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.751041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 266/546] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:29.758607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.769914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.770868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.771131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.771399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.779981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.781552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:29.798963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:29.801014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:29.803696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 281/547] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:29.809455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:29.918231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523457f-9632-4c1e-b0b5-e5aeb2f3d384 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:29.957167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:29.958324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:29.958756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:29.959179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:29.960214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:29.960722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:29.965594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:29.966706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:30.016183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 282/548] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:30.025434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:30.052149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81848bce-afa8-4a65-ab05-94a059f2db52 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:30.085286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:30.086147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.086523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.086894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.087861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=7f079c8cd88047f6b563caff1dc5e52a) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:30.088281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:30.089919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20943a76-3e95-4662-bbfa-086b065d268f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:30.097801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 267/549] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:29 2022] GET /identity/v3/role_assignments?user.id=7f079c8cd88047f6b563caff1dc5e52a&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:30.105361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6198f1-ca9d-4306-98d3-ac524cd2af36 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.105361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6198f1-ca9d-4306-98d3-ac524cd2af36 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.105361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6198f1-ca9d-4306-98d3-ac524cd2af36 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.105745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 268/550] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:30.108109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.108973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.108973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.128451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:30.129864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:30.175387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:30.199834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fce8-e69a-4af7-8e68-2868a405074b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:30.256927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4868-d80a-4b62-8960-72dc08363e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:30.259564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4868-d80a-4b62-8960-72dc08363e1f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.260508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4868-d80a-4b62-8960-72dc08363e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.262654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4868-d80a-4b62-8960-72dc08363e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.305252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 269/551] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:30.327661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:30.356591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:30.387670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c4868-d80a-4b62-8960-72dc08363e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:30.389684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c4868-d80a-4b62-8960-72dc08363e1f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:30.449993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd426ad8-0fc2-4f75-aa87-e256c0e9b2ef None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:30.503991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26dee0-9ae9-4cbc-b785-76c7a912b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:30.504820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26dee0-9ae9-4cbc-b785-76c7a912b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.505103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26dee0-9ae9-4cbc-b785-76c7a912b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.505409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26dee0-9ae9-4cbc-b785-76c7a912b0d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.522494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26dee0-9ae9-4cbc-b785-76c7a912b0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9b26dee0-9ae9-4cbc-b785-76c7a912b0d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:30.532848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:30.533988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:30.534804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:30.535439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 270/552] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:30.537351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdbca-27a1-4c62-9ca1-920b6fd89d04 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.537740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdbca-27a1-4c62-9ca1-920b6fd89d04 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.538151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdbca-27a1-4c62-9ca1-920b6fd89d04 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.541417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 271/553] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:30.542313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdbca-27a1-4c62-9ca1-920b6fd89d04 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:30.558217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 283/554] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:30.559860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.560151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.560339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:30.560496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.585220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:30.586496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:30.677453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdbca-27a1-4c62-9ca1-920b6fd89d04 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:30.693474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 284/555] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:30.694680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:30.733052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:30.733419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:30.734186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.734661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.735303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.736127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:30.736439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:30.738864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:30.751150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 272/556] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:30.752012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:30.842777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:30.845138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f47af-0b7a-463f-a3e4-8f0e0bf85a18 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:30.882556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:30.883554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.883841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.884018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ec36-8720-4c2b-b977-9f4271ba44c8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:30.884173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.896818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:30.898341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:30.917684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:30.919725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:30.921928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:30.921928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:30.921928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:30.921928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:30.921928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 285/557] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:30.921928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:30.930182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:30.931161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:30.931439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:30.931716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:30.945599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:30.954515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:30.957087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 273/558] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:30.959152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.017664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.064930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288f3f-c10a-4fe6-b5d6-22e7d20deda7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.106631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea684437-427c-40f3-8eaa-9959bb48c8a6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.109043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.110448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.110955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.111419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.123480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.125613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.147778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:31.152319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:31.154086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:31.155945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:31.155945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:31.155945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:31.155945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:31.156441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.156441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.156441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.156441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.157793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:31.157793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.159075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.161133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 286/559] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:31.163443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.188691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 274/560] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:31.190681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.296873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e49c71-0e03-4a4b-a798-0953245e78a6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.319043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab991a-27f1-4d86-8861-73f75987fd2e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.323685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.336834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.337563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.337847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.338122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.338880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:31.339190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.340589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.349789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 287/561] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:31.350628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.368594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.369685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.370155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.370499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.371313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:31.371620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.373226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fa45-5f25-4dd8-9dd7-d63603148ba0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.391726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 275/562] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:31.391726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68a33-2fa0-4033-b969-99b1cf018891 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.391726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68a33-2fa0-4033-b969-99b1cf018891 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.391726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb68a33-2fa0-4033-b969-99b1cf018891 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.391726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 276/563] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:31.391726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68a33-2fa0-4033-b969-99b1cf018891 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.460057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.475060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d992799-16b8-4614-a76f-44ca62ebb2a2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.512323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.513152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.513471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.513745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.521631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.522989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb68a33-2fa0-4033-b969-99b1cf018891 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.523111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:31.542733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:31.543692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:31.544589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:31.545650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 288/564] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:31.546737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.565891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.566748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.566991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.567262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.579856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.581264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-05354caf-b78a-4924-b510-796f5034ef22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:31.599436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:31.600388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:31.601268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:31.601268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:31.601268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:31.601268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:31.601268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 277/565] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:31.602016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.602194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.602721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.603196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.620609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:31.621770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:31.670042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a562f-4bcf-4e9e-be75-2b8e2d6ffc06 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.700384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 278/566] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:31.701453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.712225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.713417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.713899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.714408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.724081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.725587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:31.741810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:31.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 289/567] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:31.743911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.753803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.831346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efda96-96d1-4793-b1a1-7d077e8bdfb0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.865487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158de925-74ea-4441-91e1-a606e117fbf2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:31.870344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.871081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.871299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.871578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.872377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:31.872684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.873900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:31.874155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.892546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 279/568] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:31.892546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:31.912284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:31.913133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:31.913454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:31.913731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:31.914798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:31.915103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:31.916519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:31.930070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 290/569] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:31.930806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.037251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.049169 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685caff0-328d-49e2-a13e-a82e04d09172 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.088413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709de2a-9a79-44e8-bfb5-64792a7f3bfa None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.092164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.093239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.093879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.094406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.105873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:32.113859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:32.115421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:32.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:32.117045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 280/570] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:32.117563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.143995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.145153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.145654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.145934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.146889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:32.147225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.148984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.174268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 291/571] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 15 22:02:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:32.175092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.203579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.250028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ecd66-e44d-445c-b75f-5396bc49115b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.291340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.292527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.293142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.293607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.295237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f433e4fc095b4c149082b305ea3c625d) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:32.295716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.298503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.300093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c02f-91a5-4bf9-8eef-a9d9a57ffb50 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.313380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 281/572] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/role_assignments?user.id=f433e4fc095b4c149082b305ea3c625d&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:32.313380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.334299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.351747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.352691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.353048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.353427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.362710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.364441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:32.381743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:32.382924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:32.384089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:32.389934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 292/573] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:32.391412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.459926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581eedf-854c-4b09-a33b-54c71dc2f14e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.503868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.505614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.506111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.507021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.508314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:32.508864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.511205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.513250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.522175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 282/574] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:32.522766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.536369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d4f30-ba62-48ca-a7a4-01424cd064bc None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.572415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.573387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.573741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.574087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.584775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.586367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-24936024-56a5-4e60-b71b-033daff1aba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:32.605055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:32.606054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:32.606921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:32.606921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:32.606921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:32.606921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:32.606921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 293/575] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:32.608105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0891-188d-4805-9232-dba89c8572ed None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.608397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0891-188d-4805-9232-dba89c8572ed None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.608675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c0891-188d-4805-9232-dba89c8572ed None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.614040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 294/576] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:32.614864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0891-188d-4805-9232-dba89c8572ed None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.616105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.639679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f3ea1-8ba9-4dfe-abeb-54a340ae83f0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.676586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.677687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.678197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.678672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.679697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:32.680205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.681807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.700845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 283/577] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:32.701744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.736005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c0891-188d-4805-9232-dba89c8572ed None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.772872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.773730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.774015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.774295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.777500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.786370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.788633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-74c8be28-7e67-4080-acf4-10918a041535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:32.807099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:32.808190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:32.809266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:32.809266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:32.809266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:32.809266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:32.813132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 295/578] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:32.814028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569ec46-21d2-4ee4-8a5c-896635ebf013 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:32.814490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.814785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.815065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.832484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:32.833737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:32.854908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:32.855710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:32.855999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:32.856274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:32.857008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:32.857316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:32.858737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:32.866589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:32.873267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 284/579] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:32.874128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.912265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 296/580] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:32.913127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:32.988417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b07c7-f2e9-46be-bc69-c27e1f288624 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.024186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.025002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.025285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.025592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.026630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a9b77-336c-4ae1-84db-e018dd5eadde None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.037472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.038938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.045881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:33.058693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:33.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:33.060648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:33.060648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:33.060648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:33.060648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:33.060648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 285/581] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:33.061611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.069203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.069920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.070239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.070484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.071208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:33.071519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.072919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.084687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 297/582] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:33.085554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.120838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.178885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71790df-3244-4d89-8b6a-b763301d4dc7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.193294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5a29-6fa7-4e29-bb86-f71698ba06a0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.213242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.214082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.214367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.214641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.226648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.227466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.227726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.227831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.228005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.229201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.239232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:33.246852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:33.247903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:33.248988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:33.249551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:33.250618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:33.251445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:33.252218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 286/583] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:33.252218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.253077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 298/584] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:33.254060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.298374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.362689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76038a-8ab8-49be-84ba-a9ae1c650a23 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.368362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70917d-211c-4b98-a493-66e961d90ba0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.374060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.400926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.401843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.402198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.402575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.403407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:33.403814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.405341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.406849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.407924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.408691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.408952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.422825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 287/585] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:33.423035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.423156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.423248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:33.440491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:33.441844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:02:33.442973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:33.443813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 299/586] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:33.444504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.542969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a51d49-247e-4aa8-b830-591d4f600085 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.556426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.560987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52a7a-e1eb-4d2f-a0ca-6e8dc9b1557a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.580573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.581393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.581736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.582077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.582937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:33.583297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.584813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.598513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 288/587] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:33.599331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.604873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.605825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.606296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.606753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.607677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:33.608154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.609791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.618707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 300/588] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:33.619775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.636168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.713809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc29627-8532-4267-a4e6-bd1999c6c02b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.726507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38a783-2676-4ffb-be66-a0fcdf347bce None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.751516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.752425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.752708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.752983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.760044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.761548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.763213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.764069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.764352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.764629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.765506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:33.765818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.767413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:33.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:33.776568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:33.777468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 289/589] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:33.777953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.793407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 301/590] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:33.794550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.816183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.880847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:33.892456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6bc8f-c204-4233-bdc4-d4d19cd969f8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.909195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fe5b4-b300-4391-8f1b-b8fdcd50f646 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:33.932287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.933722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.934186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.934636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/d6a0960c6d4a497fbd2761d46689fdb3/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.945786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:33.946604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:33.946886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:33.947163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:33.953962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=d6a0960c6d4a497fbd2761d46689fdb3, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.955678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.958134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:33.959560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:33.981357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 290/591] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:33 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/d6a0960c6d4a497fbd2761d46689fdb3/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:33.981357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:33.981819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:33.983506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:33.983506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:33.983506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:33.983506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:33.983506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 302/592] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:33.983506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.097277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:34.106715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83220a-8cc2-41d4-90b1-c55e86397d8b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.146637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3ed2-d2e2-45bb-9604-0a51184274e0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.148912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.149725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.150076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.150423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.151444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:34.151919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.153601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.164824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:34.171410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 291/593] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:34.172178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.193960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.194970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.195207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.195480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.208761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.210393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:34.231415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:34.232364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:34.233226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:34.233226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:34.233226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:34.233226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:34.233226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 303/594] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:34.233992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.305783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd2e17-d110-4f3a-bb8b-9c9455bcf9b3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.357083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.358663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.359263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.359950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.360888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:34.361627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.363986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.372786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13094335-748c-4993-ad32-a0cae2517892 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.388867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 292/595] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:34.390382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.403975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:34.418813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.419939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.420316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.420690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/37af776e1e594cf092bdcb7cf4e86379/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.443083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=37af776e1e594cf092bdcb7cf4e86379, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.445972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.467050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 304/596] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:34 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/37af776e1e594cf092bdcb7cf4e86379/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:34.470110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.476266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:34.552663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d9fcb-0938-4fd0-8376-e5642908abde None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.623102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.624648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.625445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.626120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.627816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:34.628596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.628848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d050f4-9926-4c69-8e6f-89953766f5bf None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.631688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6073400-238c-4c16-ab0d-15bff151d580 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.653394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 293/597] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:34.656434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339eb8-1311-444d-afa6-9c4f3419f8f7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.657161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339eb8-1311-444d-afa6-9c4f3419f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.657921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73339eb8-1311-444d-afa6-9c4f3419f8f7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.660477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 294/598] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:34.662535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339eb8-1311-444d-afa6-9c4f3419f8f7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.678422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.679359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.679649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.679929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.693923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.696871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0baf7d0a-969b-4f18-b806-f65b4069bf93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:34.726977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:34.728194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 22:02:34.729410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:34.733664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 305/599] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:34.736011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.736578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.737037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.775251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:34.776841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:34.798803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73339eb8-1311-444d-afa6-9c4f3419f8f7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:34.808336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:34.830142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:34.850033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:34.851562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:34.851945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:34.852228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:34.861054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:34.862616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:34.867166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 306/600] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:34.868424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:34.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:34.881141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:34.882037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 295/601] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:34.887251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:34.982580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a6797-3344-4940-9de3-4ad6c4c64838 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.021076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.022206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.022682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.023141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.024172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:35.024695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.026550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.030574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfeae88-4915-47c0-9043-f9c3e1f0e988 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.055544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 307/602] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 15 22:02:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:35.057206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.076592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.077314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.077636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.078842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.079270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:35.079577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.081174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.085200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:35.099481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 296/603] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:35.101757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.192692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbf2c0-cc93-4406-b06c-81769458629e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.193392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:35.269974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.270999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.271206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.271482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.278815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eb9cc-6279-4232-86b0-168e2637ae3f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.285882 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:35.295443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:35.296442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:35.297621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 308/604] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:35.301543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.327132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.328064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.328391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.328666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.341092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.342661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:35.361903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:35.363954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:35.366112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:35.366112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:35.366112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:35.366112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:35.369774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 297/605] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:35.369774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.401694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:35.424826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa1884-7a84-44f8-8ffe-ba541f6d3c26 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.464418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.465642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.466067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.466478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/85cfb11b9f0e4b0eb5078ab7a14948ee/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.470707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:35.479862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643d766-4783-4512-a00a-aecb08f4ca52 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.485343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=85cfb11b9f0e4b0eb5078ab7a14948ee, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.487037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.505796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 309/606] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:35 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/85cfb11b9f0e4b0eb5078ab7a14948ee/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:35.507188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.523909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.524589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.524869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.525219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.525994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:35.526311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.527690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.539057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 298/607] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:35.549809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.643451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f520ac0-bb22-4b35-ad21-7e78c98e6374 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.684181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:35.693490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.694532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.694818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.695097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.696583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:35.697444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.699957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.715692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 310/608] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:35.721727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.739059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f1b01-9d5c-4d6c-903b-39eeb8bb5597 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.826508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.827723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.828213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.828641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.848408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5b1a7-1171-40be-90a6-df5c0677330d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:35.855203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.857122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:35.880865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:35.883473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:35.884379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:35.884379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:35.884379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:35.884379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:35.886696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 299/609] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:35.888278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:35.889132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:35.891562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:35.891562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:35.892926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.899458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:35.901173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:35.908069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:35.922185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:35.923133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:35.924026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 311/610] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:35.937465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:35.982991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:36.034805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88bfd-f1dc-4fd8-a96d-e02d0b0b11b4 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.082326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:36.083015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.083344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.083621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.084428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:36.084737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:36.086218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:36.089853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fb745-a322-4054-b446-daa99e2f9851 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.113847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 312/611] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:36.119573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:36.138953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:36.139998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.140850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.141499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.142515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:36.143045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:36.144644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:36.174223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 300/612] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:36.181961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:36.277624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6310718-0f18-4395-a7d4-84e551a7da24 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.289472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:36.316193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41677db3-4674-4967-b54e-8b8f92637119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:36.317258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677db3-4674-4967-b54e-8b8f92637119 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.317669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677db3-4674-4967-b54e-8b8f92637119 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.318019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41677db3-4674-4967-b54e-8b8f92637119 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/7f079c8cd88047f6b563caff1dc5e52a/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.337445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677db3-4674-4967-b54e-8b8f92637119 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=7f079c8cd88047f6b563caff1dc5e52a, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:36.339085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41677db3-4674-4967-b54e-8b8f92637119 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:36.352295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:36.380741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 313/613] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:36 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/7f079c8cd88047f6b563caff1dc5e52a/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:02:36.382471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f66d8-1d96-4d88-8e58-fd826e92a9c7 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.382965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f66d8-1d96-4d88-8e58-fd826e92a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.383444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f66d8-1d96-4d88-8e58-fd826e92a9c7 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.385057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 314/614] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:36.403160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.403887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.404430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.412401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef74f-9105-4179-b75b-98f49a142417 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.438038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:36.438038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:36.489242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:36.490003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.490282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.490553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.502255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:36.504016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:36.525861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:36.526917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:36.527852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:36.530408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 301/615] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:36.539040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:36.574956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 315/616] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:36.607901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:36.702957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed868e-8418-4448-867c-7590cee7090d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.715147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:36.727161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5575475-f8d8-4dfe-bba6-77dcfee56064 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.735268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:36.766642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:36.767695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.768181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.768673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.769765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:36.770279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:36.771961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:36.783534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:36.784756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:36.785236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:36.785732 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:36.807847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 302/617] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 15 22:02:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:36.809063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:36.812001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:36.822913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:36.823873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:36.824689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:36.831746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 316/618] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:36.838015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:36.976118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb436b6-0393-4283-91c9-adc4b6f64dc1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:36.992100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549fed9-2d58-4e32-b332-5490f3bd2495 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.024011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.025907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.026493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.027047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.028076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:37.028546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.030325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454d6b2-0994-4613-8e02-e32aae8e1305 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.031394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.032332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.032703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.033249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.043293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 317/619] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:37.045066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.045396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011257e-058d-4bb6-a4da-db627520124b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.045831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011257e-058d-4bb6-a4da-db627520124b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.046269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011257e-058d-4bb6-a4da-db627520124b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.047280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.048227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 318/620] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:37.049554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011257e-058d-4bb6-a4da-db627520124b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.068056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-778be5d2-d4e2-4cf8-88f1-6310544b5643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:37.069649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:37.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:37.072204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:37.072204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:37.072204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:37.072204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:37.074785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 303/621] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:37.081087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.082131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.082131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.100463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:37.101804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:37.134309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:37.182523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 304/622] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:37.183545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.195277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011257e-058d-4bb6-a4da-db627520124b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.239755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.240586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.240874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.241154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.256128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.258299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:37.281731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:37.282645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:37.283537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:37.283537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:37.283537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:37.283537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:37.283537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 319/623] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:37.284881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.310546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c36226-fe45-425b-81a3-29fac0b30c1f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.348455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.349151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.349479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.349751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.350500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:37.350806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.352246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.371486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 305/624] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:37.372529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.404677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:37.413062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:37.420184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837439-2e3d-458f-a47d-ea194f780250 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.459375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.460342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.460807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.461163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.473606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:37.482062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:37.483234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:37.484344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:37.485505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 320/625] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:37.486613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.512880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704d913-db50-4d99-80f1-522acbb0da3c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.564970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.566228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.566716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.567399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.569244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:37.569764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.571331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.588029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 306/626] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:37.589948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.603000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec017c-37a8-4d80-a092-d68db427f68e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.633370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:37.648247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.649868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.650402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.650864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.659442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.662101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:37.680170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:37.681143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:37.682195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:37.690530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 321/627] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:37.691985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.695202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:37.716660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f7405-c226-46e7-a177-51d5a9a29147 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.769451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.770358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.770644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.770918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.771756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:37.772366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.774441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.792744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 307/628] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:37.795271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.830065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe242390-c807-4234-8b7b-cf852e911288 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.870124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:37.870962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:37.871256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:37.871515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:37.880742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:37.882297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:37.898502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:37.899535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:37.900515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 322/629] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:37.901636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:37.954154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd07ee8-9b39-4998-ad08-8c77adf3f39c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:37.955074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.002786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.004428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.005201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.005721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.007398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:38.008062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.010073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.024065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0144a-ed37-4dd6-9b14-7a308fcbb361 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.029038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 308/630] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:38.030029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.042476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.071916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.073110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.073651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.074145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.089421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.091326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:38.118006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:38.118982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:38.119877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:38.119877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:38.119877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:38.119877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:38.127775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 323/631] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:38.127775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.160037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73047b-15c1-4360-bcfb-1996675845ce None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.204872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.205688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.205973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.206275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.207300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:38.207616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.209256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.236403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 309/632] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:38.237396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.262705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.269362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53971874-5fd9-4cb5-8e14-e07c8f87019f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.307366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a5ec6-9e95-4ba7-ab31-2ea4fa74bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.308583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5ec6-9e95-4ba7-ab31-2ea4fa74bcdc None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.308869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5ec6-9e95-4ba7-ab31-2ea4fa74bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.309148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a5ec6-9e95-4ba7-ab31-2ea4fa74bcdc None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f433e4fc095b4c149082b305ea3c625d/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.311421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.325069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a5ec6-9e95-4ba7-ab31-2ea4fa74bcdc None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=f433e4fc095b4c149082b305ea3c625d, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.326570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a5ec6-9e95-4ba7-ab31-2ea4fa74bcdc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.341224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 324/633] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:38 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f433e4fc095b4c149082b305ea3c625d/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:38.342317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c33e1-5bcb-4158-b217-d5b8e9fce883 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.342609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c33e1-5bcb-4158-b217-d5b8e9fce883 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.342890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c33e1-5bcb-4158-b217-d5b8e9fce883 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.348876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 325/634] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:38.348876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c33e1-5bcb-4158-b217-d5b8e9fce883 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.367127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d2710-d590-4a80-ba85-558c8339c4dc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.410183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.410924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.411160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.411470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.412714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:38.413026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.414636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e01e50-cb36-4ec3-8364-8507e1e9150c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.434684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 310/635] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:38.434684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.434684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.434684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.451438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:38.452800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:38.512635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c33e1-5bcb-4158-b217-d5b8e9fce883 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.546948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 311/636] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:38.548060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.558958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.560186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.560730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.561303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.581014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.617902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.652287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.653819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.675883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06fdc1-93b6-42ae-910a-7a8f21267558 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.717296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.718186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.718499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.718943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.727817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.729494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:38.747184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:38.748325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 312/637] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:38.749235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.785020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 326/638] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:38.790509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.839964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.861806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba16200-f967-46f3-b44c-fbe379393776 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.880775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:38.901100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6f4a-6e1a-401f-bbc5-5bfcf6957c15 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:38.905670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724ed9e-43fd-4cd6-a958-0c2d438ef909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.906648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724ed9e-43fd-4cd6-a958-0c2d438ef909 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.906935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724ed9e-43fd-4cd6-a958-0c2d438ef909 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.907211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724ed9e-43fd-4cd6-a958-0c2d438ef909 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.919565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724ed9e-43fd-4cd6-a958-0c2d438ef909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6724ed9e-43fd-4cd6-a958-0c2d438ef909 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:38.927447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:38.928433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:38.929264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 313/639] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:38.930505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef11d9-b0ca-4ef3-bf1b-a16c2605a4d2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.930505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef11d9-b0ca-4ef3-bf1b-a16c2605a4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.930635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef11d9-b0ca-4ef3-bf1b-a16c2605a4d2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.935856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 314/640] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:38.936569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef11d9-b0ca-4ef3-bf1b-a16c2605a4d2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:38.951471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:38.952418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:38.952890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:38.953947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:38.957389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:38.957729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:38.963544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:38.988329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 327/641] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:38.989280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.056205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef11d9-b0ca-4ef3-bf1b-a16c2605a4d2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.092695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.093622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.093916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.094191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.097138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca19b39-9328-4195-bdc7-a6c87b3fbc25 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.100415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.105466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.106915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b62d1a50-8dd4-47d8-a5df-2fb886d19ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:39.124343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:39.125652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:39.126539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:39.126539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:39.126539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:39.126539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:39.130437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 315/642] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:39.131697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.131926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.132199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.137432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.138675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.138675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.138675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.139406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:39.139713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.141174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.149865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:39.151090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:39.158132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 328/643] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:39.158132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.183535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.256979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 316/644] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:39.256979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.283252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fa1d9-f3a4-4cf4-b5a3-c6921e54fd11 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.326497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e864b-d552-410b-ac24-5783d362425e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.327154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e864b-d552-410b-ac24-5783d362425e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.327439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e864b-d552-410b-ac24-5783d362425e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.327715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e864b-d552-410b-ac24-5783d362425e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.366228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.375628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105dd76-6027-4f3f-b20c-f88ca3899d47 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.402690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e864b-d552-410b-ac24-5783d362425e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.404108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e864b-d552-410b-ac24-5783d362425e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.415222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.415990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.416623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.417106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.418025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:39.418401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.420335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.434257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 317/645] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:39.435108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.459160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.514228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 329/646] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:39.515093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e864b-d552-410b-ac24-5783d362425e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.562736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4702-2c42-4e49-942e-6e62591501b5 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.591218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.606586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.607986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.608270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.608548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.621247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.622757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.631706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e864b-d552-410b-ac24-5783d362425e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:39.641376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:39.642431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:39.643543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:39.643543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:39.643543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:39.643543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:39.643543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 318/647] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:39.643827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.675208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.676028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.676306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.676593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.689571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:39.697267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:39.698324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:39.699156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 330/648] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:39.699877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.725534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.759898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60009a79-56b6-48de-a1ec-38dfd324a1af None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.795079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.795895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.796173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.796454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.803356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.804819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.809418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577e5cf-4922-4a8d-a2bc-5a06c2f98ea7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:39.819332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:39.820262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:39.821162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 319/649] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:39.822120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.842182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.852241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.853044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.853295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.853609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.864924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.866393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:39.884844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:39.885891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:39.886854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:39.886854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:39.886854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:39.886854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:39.886854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 331/650] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:39.887150 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:39.939346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19300-7be8-434a-aec8-6c109ed4e6cc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:39.969821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:39.976557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:39.977261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:39.977567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:39.977844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:39.978597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:39.978892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:39.980283 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:39.996928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 320/651] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:39.996928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.011077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218faf-a5c3-49cd-bd74-2ba1cd6fda25 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.050666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.051350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.051636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.051904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.053278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.053619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.055012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.065708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 332/652] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.066127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.112032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:40.113838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777ffb-38e6-4ec1-a92f-b527d6591b21 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.153702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.154539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.154816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.155126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.156298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.157270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.158395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.180911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 321/653] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.180911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.199053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8398d2-8424-49d7-b857-0683cf1f0ff7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.256710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:40.262150 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.262918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.263204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.263494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.264238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.264549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.266276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.279413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 333/654] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.328394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1111f9-6665-4922-884c-5c4ff446e3be None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.367954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.369013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.369419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.369702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.378735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.380197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:40.395922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:40.397144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 322/655] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:40.398113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.408155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:40.412636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d1224-ab16-4b72-8183-1563539edc38 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.451191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.451893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.452175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.452447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.465718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.467215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:40.487136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:40.488127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:40.488988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:40.488988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:40.488988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:40.488988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:40.488988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 334/656] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:40.489719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.518825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76dc7a-a39e-4aad-ae9d-f123e01ed18b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.534171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:40.566837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.567767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.568226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.568486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.569485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=d6a0960c6d4a497fbd2761d46689fdb3) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.569802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.571256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.585370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 323/657] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/role_assignments?user.id=d6a0960c6d4a497fbd2761d46689fdb3&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.585370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.622701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88320e-ee45-4df6-b221-60a341d942ef None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.667740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.668581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.668849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.669121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.678474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.680397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:40.696564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:40.698070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:40.699265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:40.704554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 335/658] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:40.705854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.723453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:40.728875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11564255-d0ae-4da4-ab33-4df5aab5139c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.776978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.780451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.780451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.780451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.780451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.780451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.780868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f18a7-70a9-454a-9f46-5b43decbeadc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.800455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 324/659] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.802752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a65542-9b34-4168-a0c6-fa7344f68b42 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.803213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a65542-9b34-4168-a0c6-fa7344f68b42 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.803631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a65542-9b34-4168-a0c6-fa7344f68b42 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.805369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 325/660] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:40.806266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a65542-9b34-4168-a0c6-fa7344f68b42 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.843318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:40.853529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b6c4-a3d1-43fb-801c-d8cff10a12c7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.892819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.893553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.893848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.894120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.894858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.895179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.896607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.910982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 336/661] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.916623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:40.932468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a65542-9b34-4168-a0c6-fa7344f68b42 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:40.971198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:40.971772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.972086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.972366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:40.973142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:40.973507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:40.974979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056560cb-c9cc-423b-8862-ea5cb381bd4e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:40.993356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 326/662] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:40.993356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:40.993356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:40.993356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.009870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.010077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:41.011453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:41.046916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb9aa6-7f77-4c29-ab66-460271b810e3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.083856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.084525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.084810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.085081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.088878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 327/663] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:41.089877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.114897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.173051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:41.174569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:41.201230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af2001-825e-483d-ae93-8d5938c7bc8c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.242514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.243335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.243612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.243884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.252342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:41.253845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:41.254932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:41.269523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:41.270529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:41.271449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 328/664] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:41.272043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.297735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 337/665] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:41.298528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.363923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.386496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f00d-e938-4f60-b2b2-9d2cc15d2f8f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.410351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a985c6-8bf8-4ff9-a588-d6486268490f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.425824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.426492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.426777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.427057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.427886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=37af776e1e594cf092bdcb7cf4e86379) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:41.428203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:41.429682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:41.445357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 329/666] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/role_assignments?user.id=37af776e1e594cf092bdcb7cf4e86379&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:41.445357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.462325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.463171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.463449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.463727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.476637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:41.484942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:41.485990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:41.486817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 338/667] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:41.487497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.527751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.587018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709bd88-08e7-477e-be0b-3a46099651d7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.618195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9a680-9d79-4ebe-afed-4441e7a435c9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.636389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.637083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.637400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.637674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.638582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:41.638937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:41.640496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:41.665832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 330/668] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:41.666424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.666680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.667689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.668175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.668686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.670407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.691772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:41.693310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:41.718172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:41.719222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:41.720107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:41.720107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:41.720107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:41.720107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:41.720107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 339/669] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:41.720948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.805804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd69863-20b0-4c4c-9a83-43aaf98a86f2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.827343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.844988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.845962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.846401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.846863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.847785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:41.848261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:41.848818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f43e3-c4fd-4c58-8e18-97c2b5c0b6d1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:41.850129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:41.864214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 331/670] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:41.865463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:41.895771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:41.896810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:41.897164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:41.897551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:41.941191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:41.985526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae93792-7163-43e4-b668-ed9d0d1c4551 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.005593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.009140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.024118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.025317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.025793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.026233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.027483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:42.028198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.029960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.051186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 332/671] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:42.051186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.127987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:42.151828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 340/672] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:42.151828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.178508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b80ef-264c-4dbf-9309-71fe17a099c3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.211793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:42.226802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.227854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.228897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.229889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.248175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.250181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.267733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee31390-80c2-4f24-bd6d-1a3b61642dfd None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:42.274040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:42.275191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:42.276301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:42.276301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:42.276301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:42.276301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:42.278772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 333/673] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:42.279799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.319070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.320216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.320594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.320965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.329516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.331538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:42.349351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:42.350494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:42.351385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:42.356539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 341/674] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:42.357679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.407676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409f9cb-2248-4bae-884a-828df98e697e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.414682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:42.459898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.461361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.461813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.462474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.477662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.479680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.480201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c947b2a-40cf-4e3a-a526-f12db419305d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:42.504460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:42.505424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:42.506302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:42.506302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:42.506302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:42.506302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:42.507254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 334/675] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:42.508332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.533514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.534959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.535436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.535923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.537200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:42.538242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.540132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.546933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:42.558790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 342/676] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:42.560496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.644849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026b3b-09c4-4def-b0b4-2cff14895dda None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.676926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b342f1-8db2-4471-8bf0-60acffab76d7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.680313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:42.698754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.699436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.699717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.699992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.700788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:42.701098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.702582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.720360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 335/677] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:42.721279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.727753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.728719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.729220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.729707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.731168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:42.731740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.733838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.753956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 343/678] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:42.753956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.851170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:42.865767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dbdce-0b59-4b66-8b9a-f1c430bc6c45 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.874847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314143e4-bc60-4aac-adc9-8945f9785225 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:42.903630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.904445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.904724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.904995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] PATH_INFO: `/v3/users/swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.915931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.917437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.917694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:42.918538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.918944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.919419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.920394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=85cfb11b9f0e4b0eb5078ab7a14948ee) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:42.920906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:42.922747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:42.929047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 344/679] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/role_assignments?user.id=85cfb11b9f0e4b0eb5078ab7a14948ee&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:42.929811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-7b18c354-16ec-4c4c-800b-dc6e17d781de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:42.934540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:42.935494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:42.936416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 336/680] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:42.937601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69c03b-744e-486b-b1df-05abe651913a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:42.938011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69c03b-744e-486b-b1df-05abe651913a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:42.938300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69c03b-744e-486b-b1df-05abe651913a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:42.943889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 337/681] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:42.944824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69c03b-744e-486b-b1df-05abe651913a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:42.970147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.077861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb7800-739e-45d8-9f4a-e0beb6dcc096 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.086425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69c03b-744e-486b-b1df-05abe651913a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.129969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.130819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.131162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.131441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.131934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.132835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.133411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.133830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.134825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:43.135359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.137181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55effc8c-1f68-4f45-8e44-3c47982d73de None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:43.139832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.142190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:43.158756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 338/682] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:43.160537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:43.160739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:43.162439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:43.163656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:43.164446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.164446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.166649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 345/683] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:43.168249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:43.185581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:43.186696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:43.188948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.283816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.301346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 339/684] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:43.301346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:43.305900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce548-e8af-43d3-b553-46ac246f0a78 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.362336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.363797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.364300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.365087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.438956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393c25e-5067-45a6-a3c2-3150fd63d2d0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.456435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.458787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:43.479906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c113f-e705-42f0-be60-e703816b509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.480523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c113f-e705-42f0-be60-e703816b509d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.480799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c113f-e705-42f0-be60-e703816b509d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.481067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c113f-e705-42f0-be60-e703816b509d None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.481909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c113f-e705-42f0-be60-e703816b509d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:43.482216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c113f-e705-42f0-be60-e703816b509d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.483877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c113f-e705-42f0-be60-e703816b509d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:43.501933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.505490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 340/685] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:43.506429 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c113f-e705-42f0-be60-e703816b509d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:43.572670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.588936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 346/686] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:43.589918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:43.638899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c113f-e705-42f0-be60-e703816b509d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.679678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.680551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.680833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.681103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.693965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.695471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:43.715986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:43.716931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:43.717875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:43.717875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:43.717875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:43.717875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:43.722743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 341/687] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:43.723973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:43.727622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2559a-9f83-4bf7-9a82-6563a14f9c37 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.777104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.778518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.779001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.779466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.780979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=7f079c8cd88047f6b563caff1dc5e52a) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:43.782220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.784302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:43.793932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 347/688] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:43 2022] GET /identity/v3/role_assignments?user.id=7f079c8cd88047f6b563caff1dc5e52a&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:43.795205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:43.805832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.870841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:43.892583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22724992-646d-4e45-9b53-4d692038a66b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.950288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb60ce1-f3f7-4bf7-abb9-454992078c54 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:43.951127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:43.952276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:43.952640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:43.953585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:43.976373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:43.977990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-afa6664f-6bd5-4784-b81f-40c00fc2ad2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:44.002480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:44.003509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:44.004393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:44.004393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:44.004393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:44.004393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:44.006341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 342/689] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:44.008146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73238-d1e7-4c0b-b68a-783a244c84a3 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.008709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73238-d1e7-4c0b-b68a-783a244c84a3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.009829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73238-d1e7-4c0b-b68a-783a244c84a3 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.016439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.016658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 343/690] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:44.016658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d73238-d1e7-4c0b-b68a-783a244c84a3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.017983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.018500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.018994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.025997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:44.026661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.028305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0c8c5-b856-4951-9814-c111063b9f9e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.044297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 348/691] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:44.045688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.045965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.046246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.069751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:44.071005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:44.153459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 349/692] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:44.154558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.160099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d73238-d1e7-4c0b-b68a-783a244c84a3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.162185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:44.201130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.201853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:44.202566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.203032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.203396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.204166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:44.204475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.206675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.221397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 344/693] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:44.222377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.272439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a89a-c2e9-4e6b-b65b-b04be2cd0dba None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.316869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.318903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.319336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.319763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.320737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.322574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.339677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3cad0-dedf-4f01-b355-79419f18e432 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.360493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 350/694] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:02:44 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:44.360493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.417504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.418342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.418625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.418902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.445411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:44.453749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:44.454774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:44.455878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 345/695] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:44.461776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.517699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:44.535058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:44.539819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e64d2f-a034-4727-ae3d-9b880cc2dc86 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.586553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.587403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.587683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.587957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.600479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.603167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:44.632056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:44.633024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:44.633935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:44.637452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 351/696] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:44.639776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.668399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91da10a-b9de-4df2-8fe6-0f873ad3d4dd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.720224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.720878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.721108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.721425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.722206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:44.722516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.723992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.734226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 346/697] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:44.744022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.761775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116c063-9303-4ba0-bca6-db9a3f1c08fb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.801766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.802563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.802853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.803132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.804037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:44.804346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.806375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.824691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 352/698] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:44.826353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:44.851538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:44.863008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:44.891231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14ea43-0f42-4359-9a2c-695747fcb9d8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:44.950296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:44.951137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:44.951522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:44.951992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:44.973545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:44.975534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:44.996081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:44.997056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:44.998020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:44.998020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:44.998020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:44.998020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:45.001734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 347/699] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:45.007833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:45.010554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de45a4c-9fd8-4edc-8fcc-0f0a332f3817 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:45.111151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:45.111151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.111525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.111715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.112548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f433e4fc095b4c149082b305ea3c625d) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:45.112864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:45.114446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:45.133358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 353/700] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:44 2022] GET /identity/v3/role_assignments?user.id=f433e4fc095b4c149082b305ea3c625d&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:45.181554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2b3c-8c1a-48a2-8106-56509df13927 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:45.228541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:45.230103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.230602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.231052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.231975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:45.232452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:45.234285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828e47-813f-4c6f-9034-10a258ed053e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:45.241366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:45.251574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 348/701] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:45.257380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:45.422076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:45.450484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab02bd6-5df3-4b6f-bb3f-76af5e9c582d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:45.487375 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1db3-ed9a-4feb-be69-d5507d3d0e41 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.487555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1db3-ed9a-4feb-be69-d5507d3d0e41 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.487834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1db3-ed9a-4feb-be69-d5507d3d0e41 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.489226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 349/702] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:02:45.495626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.496240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.496718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.502063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:45.502921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.503211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.503490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.514036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:45.515754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:45.522854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:45.524409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:45.534206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:45.535182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:45.536170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 354/703] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:02:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:45.545096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:45.622411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 350/704] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:45.656992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:45.686661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e309c4b-9a2c-424f-82b6-a7d6c7cd6072 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:45.741201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:45.741977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.742262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.742539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.743665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:45.744002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:45.746023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:45.774451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:45.785041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 355/705] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:02:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:45.786890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:45.844026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c3f4c-65ac-42f1-afb3-8f63d7afa485 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:45.902947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:45.915289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:45.916134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.916420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.916695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:45.917951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd68ca1-487f-4410-be12-e523af5ae6c6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:45.925596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:45.927473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:45.955685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:45.956719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:45.957579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:45.961592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 351/706] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 15 22:02:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:45.968069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:45.970542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:45.971529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:45.971979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:45.972419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.078317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:46.083143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.086961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.176950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84661fde-e792-4b26-92f5-625cb2eb280e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:46.212409 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 356/707] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 22:02:46.218406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:46.291582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:46.292292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.292576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.292855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.293611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:46.293923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.295367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.309850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 352/708] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 15 22:02:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:46.314548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:46.342022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:46.346167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f871e1-b00f-41c3-a293-1995389eb5d3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:46.384127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:46.384945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.385226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.385551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.396988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.398497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.404486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-a3e1df79-1d6f-45fb-a48a-455f1a6e8569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:46.418382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:46.419338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:46.420217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:46.420217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:46.420217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:46.420217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:46.420217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 357/709] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:46.426683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1858-7ae4-492c-bf73-2aa8023b3239 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.426683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1858-7ae4-492c-bf73-2aa8023b3239 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.427374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed1858-7ae4-492c-bf73-2aa8023b3239 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.432393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 358/710] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:46.432393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1858-7ae4-492c-bf73-2aa8023b3239 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:46.466001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb695c25-a7eb-4f3f-bcae-4d9170a910ed None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:46.504906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:46.506049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.506522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.507006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.507972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:46.508482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.510426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26b5fa-0aaf-493f-a2bd-7da4d527e38e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.521648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 353/711] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:46.523768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.524323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.524792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.539024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed1858-7ae4-492c-bf73-2aa8023b3239 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:46.570195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:46.571801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:46.585375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:46.585375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.585375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.585375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.585779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:46.585779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.585779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.598060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 359/712] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:46.603728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:46.632570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:46.721349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 354/713] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:46.743729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:46.803148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc2f2e-f27b-41b7-81a0-bfd9ee37295f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:46.817794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:46.855463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:46.856889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.857191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.857506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.868284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.869932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.887540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9091e6-d71e-41ff-9d56-09ecca3dcec9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:46.890877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:46.891902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:46.892832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 360/714] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:46.899363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:46.942493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:46.943746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:46.944543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:46.945642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] PATH_INFO: `/v3/services/network` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:46.947117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:46.949981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:46.978369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:46.979433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:02:46.980276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:46.989528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 355/715] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/services/network => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:46.992509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:47.054902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:47.099735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e9f92-70ee-41a3-82a0-76c38b03273e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:47.173549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:47.175141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.175622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.176146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.177209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:47.177774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:47.179829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:47.197212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 361/716] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:47.207273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:47.232858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67e3fd-ac0a-44ae-b3d1-ba9695b56c65 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:47.263030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:47.289229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:47.289966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.290352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.290642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.291359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] RBAC: Adding query filter params (name=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:47.291672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:47.293188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fdbd3-8808-4718-a653-d8f66624350f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:47.298945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 356/717] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:02:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:47.300405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cb301-7e90-483f-9f31-28b0b7ec4178 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.300703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cb301-7e90-483f-9f31-28b0b7ec4178 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.300983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cb301-7e90-483f-9f31-28b0b7ec4178 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.307147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 357/718] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:47.308118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cb301-7e90-483f-9f31-28b0b7ec4178 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:47.369305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc3887-c97a-4408-b871-6bfa340464cb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:47.408891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:47.415069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:47.416078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.416530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.417487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.418184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=37af776e1e594cf092bdcb7cf4e86379) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:47.418764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:47.420548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ad66-979c-4b8e-be6b-91a3c551eb41 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:47.428045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 362/719] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:47 2022] GET /identity/v3/role_assignments?user.id=37af776e1e594cf092bdcb7cf4e86379&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:47.430420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.430916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.431375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.439497 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cb301-7e90-483f-9f31-28b0b7ec4178 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:47.451278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:47.453081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:47.505367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:47.505873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.506157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.506490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.507212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:47.507605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:47.509045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:47.523534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 358/720] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:02:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:47.534630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 363/721] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:47.559611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:47.624244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:47.712440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23a63a-88d2-4a53-95ac-7332ea268ed0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:47.750220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:47.751089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.751372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.751649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.764353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:47.772474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:47.773629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:47.774449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 359/722] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:47.780209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:47.896314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f075f-aad0-4a03-88f2-8909c3d66c4c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:47.929066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:47.939189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:47.939917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:47.940202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:47.940530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:47.941312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:47.941655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:47.943086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66f7e5-0b7c-4d83-9144-34c47558df25 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:47.953373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 364/723] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:47.959001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:48.106294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:48.108183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf6c4-3bfd-4c5b-859e-332d12de0292 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:48.108534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf6c4-3bfd-4c5b-859e-332d12de0292 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:48.108828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf6c4-3bfd-4c5b-859e-332d12de0292 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:48.110718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 365/724] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:48.111605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807d3e-3e5d-49c4-bc8d-5560992d3963 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:48.116396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:48.116712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:48.116966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:48.136323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:48.137560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:48.174707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:48.175893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:48.176502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:48.176983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:48.194253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:48.196229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:48.214208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 366/725] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:48.217459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:48.218391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:48.219316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:48.219316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:48.219316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:48.219316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:48.221876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 360/726] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:48.234812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:48.262354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:48.369019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280e40-a3b8-4c7b-8da0-dd6f31e871c6 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:48.392691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:48.428430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:48.429134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:48.429456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:48.429728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:48.430468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:48.430772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:48.432180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:48.464107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 367/727] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:48.470363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:48.494613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889a0b-d394-4f5c-aa2b-4eb7a184042b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:48.578171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:48.579004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:48.579287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:48.579565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:48.646197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:48.663210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:48.664213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:48.665029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:48.670545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb2ba9-2e08-42f8-9944-ad9b5e9ba4d0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:48.678444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 361/728] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:48.694464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:48.713850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:48.715133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:48.715646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:48.716152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:48.725935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:48.727775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:48.744442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:48.745474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:02:48.746402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:48.749150 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 368/729] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:02:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:48.753585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:48.756474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:48.837779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:48.967326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de3dd-b513-46c2-8a4e-12bd3a5eacbc None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:48.988886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9783070-1f72-4a59-816b-e538d7852d81 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:49.054257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.055017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.055311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.055598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.056565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:49.056889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.058509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.097177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.097938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 369/730] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 15 22:02:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:49.099608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.099894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.100378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.100958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:49.101267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.102722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.103693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.128459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 362/731] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:49.142675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.271465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:49.279506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d17e76-a483-4db4-9667-bd5be99b9594 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:49.332230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e90137-189b-4b70-a1c1-c14211f4881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.333356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90137-189b-4b70-a1c1-c14211f4881b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.333655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90137-189b-4b70-a1c1-c14211f4881b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.334510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e90137-189b-4b70-a1c1-c14211f4881b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.370124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:49.401356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cf2e-4d05-4cd1-a764-1c4c6ed020e9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:49.426232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e90137-189b-4b70-a1c1-c14211f4881b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.428266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e90137-189b-4b70-a1c1-c14211f4881b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.438951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.439777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.440059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.440335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.455160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.456668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-6acb66e0-ae61-4034-b0a8-62b1798b9b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:49.479749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:49.480700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:49.481667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:49.481667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:49.481667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:49.481667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:49.485486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 363/732] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:49.487232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2e528-009d-4554-8015-4f171c7b0d41 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.487520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2e528-009d-4554-8015-4f171c7b0d41 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.487797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2e528-009d-4554-8015-4f171c7b0d41 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.489388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 364/733] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:49.489923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2e528-009d-4554-8015-4f171c7b0d41 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.565222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:49.577371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 370/734] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:49.577371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.577371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.577371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.604724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:49.606982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:49.644292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2e528-009d-4554-8015-4f171c7b0d41 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:49.674860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:49.685455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542eab-6037-4795-a33b-bc924725966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.686291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542eab-6037-4795-a33b-bc924725966d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.686693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542eab-6037-4795-a33b-bc924725966d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.687325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542eab-6037-4795-a33b-bc924725966d None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.687942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542eab-6037-4795-a33b-bc924725966d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:49.688353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542eab-6037-4795-a33b-bc924725966d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.690004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542eab-6037-4795-a33b-bc924725966d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.691468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 371/735] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:49.692579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.704703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 365/736] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:49.710548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542eab-6037-4795-a33b-bc924725966d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.803896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce2d7-eb35-4912-ad0c-98bf53aea2cf None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:49.833638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:49.838619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542eab-6037-4795-a33b-bc924725966d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:49.844030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.845073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.845280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.845582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.856769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.858404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:49.878137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:49.879105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:49.879982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:49.879982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:49.879982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:49.879982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:49.884287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 372/737] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:49.885222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.888217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:49.889635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:49.890201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:49.890707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:49.900733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:49.903146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:49.922393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:49.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:49.924760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:49.933088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 366/738] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:49.934656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:49.998621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:50.006695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21372e0e-cc0f-4866-b5b2-2a10e2685c32 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.050689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.051432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.051719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.051995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.052735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.054224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:50.071260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40172caf-a54e-4713-80e5-bb5c81acdea1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.077371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 373/739] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:02:49 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:50.077371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:50.129593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:50.182239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.183459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.183979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.184542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.185553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:50.186080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.187956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:50.211885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb6c80-1d58-48f3-a37c-11b181a0fed3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.218392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 367/740] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:50.226628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:50.263280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.264223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.265779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.266137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.268430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:50.269073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.272361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:50.295998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 374/741] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 15 22:02:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:50.306917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:50.392314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a4a7-15ab-4b5a-9d58-122e90231597 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.394589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:50.451723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:50.456946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.458819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.458819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.458819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.459222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8543-bf6c-4186-87b0-adfaaf31f21b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.466651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.468137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2c085607-def8-4838-942d-174aa77ef706 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:50.488535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:50.489877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:50.490903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 368/742] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:50.491636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fb186-2cec-4d3f-94ac-3fbd33980a56 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.492599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fb186-2cec-4d3f-94ac-3fbd33980a56 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.492599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fb186-2cec-4d3f-94ac-3fbd33980a56 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.497954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 369/743] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:50.500101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fb186-2cec-4d3f-94ac-3fbd33980a56 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:50.518975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.519672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.520516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.520837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.621842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.623379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:50.640802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fb186-2cec-4d3f-94ac-3fbd33980a56 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.701894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.702996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.703829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.704341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.706332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:50.706783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.709222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f738cb-0ce9-4f0a-9f08-9e55cbed67a0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:50.738301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 370/744] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:50.738301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951abb-c4e1-467d-b52d-7303261b1bae None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.738301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951abb-c4e1-467d-b52d-7303261b1bae None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.738301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d951abb-c4e1-467d-b52d-7303261b1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.761649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5d951abb-c4e1-467d-b52d-7303261b1bae None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:50.763202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5d951abb-c4e1-467d-b52d-7303261b1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:50.775051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:50.793357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 375/745] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:02:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 22:02:50.793357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:50.800457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:50.867305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 371/746] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:50.869503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de4880-52e0-4497-9c6a-1aad0e0fbf3b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.869810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de4880-52e0-4497-9c6a-1aad0e0fbf3b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.870294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de4880-52e0-4497-9c6a-1aad0e0fbf3b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.872233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 372/747] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:50.872720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de4880-52e0-4497-9c6a-1aad0e0fbf3b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:50.935988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6431c44-4d57-4a74-adcf-38651cd540b0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:50.992583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:50.993733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:50.994014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:50.994305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:50.998754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=fb8c1184414947a8ad358a0eb891ba30) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:50.998754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:50.998754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4f176-6ac4-4038-92e7-894bc3a8548c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:51.013370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 376/748] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:50 2022] GET /identity/v3/role_assignments?user.id=fb8c1184414947a8ad358a0eb891ba30&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:51.013370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.013370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.013370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:51.029878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:51.031251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:51.046996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de4880-52e0-4497-9c6a-1aad0e0fbf3b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:51.114873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:51.115707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.115991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.116269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:51.121619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:51.136826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:51.139968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:51.144428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 377/749] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 22:02:51.145913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:51.182002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:51.182969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:51.183852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:51.183852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:51.183852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:51.183852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:51.185148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 373/750] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:51.189782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:51.200508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:51.354385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2081c-c363-430e-b6bc-2b6040eb6805 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:51.375404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50d2ce-c4b9-4eac-a05e-ce4cee060bbb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:51.404752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:51.406990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.407461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.407922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:51.424556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:51.424768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:51.425343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.425764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.426044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:51.426820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:51.428499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:51.433887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:51.434989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:51.435940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:51.438997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 378/751] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:51.440544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:51.454468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 374/752] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:02:51 2022] POST /identity/v3/services => generated 240 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:51.455726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:51.508889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:51.574100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:51.588139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edcfda-f1a7-44ab-b414-4a9af00df274 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:51.656086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:51.657838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.666026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.666445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc0ca7-a533-4450-8c21-1d4ce30893f4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:51.666715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:51.667676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:51.668143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:51.670121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:51.710448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:51.711211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.711493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.711769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:51.712571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:51.712881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:51.721356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:51.726570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 375/753] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:51.738813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:51.843728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 379/754] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:51.845240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:51.901970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bc00a-aa35-4627-8ec2-f9d159e5175b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:51.949440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:51.976723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:51.977693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:51.977970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:51.978323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:52.006495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:52.007984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:52.011336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d41e2-293e-4dca-a840-d6cae229710a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:52.020861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:52.068342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:52.069654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:52.070540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:52.070540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:52.070540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:52.070540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:52.075226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 376/755] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:52.081737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:52.129525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:52.130871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:52.131565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:52.132110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:52.153630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:52.155583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:52.200092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:52.201191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:52.202329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 380/756] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:52.210441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:52.264193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184f266-e837-4bf3-b03e-afe443881299 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:52.319425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:52.320634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:52.321116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:52.321676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:52.322822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:52.323558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:52.325389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:52.358731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 377/757] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:52.366245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:52.424414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:52.506086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54251e-3252-48d9-94d2-c5167b25adda None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:52.547511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0ef6-9464-4fde-9965-d50764cc2a65 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:52.552637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:52.553977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:52.555565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:52.556093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:52.565204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:52.567628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:52.585563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:52.586571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:52.587502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:52.590510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 378/758] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:02:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:52.599017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:52.645856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:52.646557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:52.646858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:52.647119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:52.647977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:52.648276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:52.649783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:52.681565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 381/759] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:52.686493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:52.785850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:52.805348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:52.810819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c73dea-2442-4f3b-b9dc-67353686b742 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:52.853308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:52.855649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:52.857818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:52.859413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:52.863254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:52.864541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:52.866461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:52.912183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 379/760] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:02:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:52.913802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:52.978168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c417a-87ea-4398-9b5b-1feb71c5125d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:53.060127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:53.061234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.061691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.062202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.063400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f433e4fc095b4c149082b305ea3c625d) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:53.069907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:53.071884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966dbfa9-680d-4a56-a8e4-c8c558a0b0f4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:53.084402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 382/761] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:02:52 2022] GET /identity/v3/role_assignments?user.id=f433e4fc095b4c149082b305ea3c625d&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:53.109545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b854b9-6dd9-4cf0-8105-3c30a3d54ba3 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.110073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b854b9-6dd9-4cf0-8105-3c30a3d54ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.110497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b854b9-6dd9-4cf0-8105-3c30a3d54ba3 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.112629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 383/762] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:53.118536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa34df1-c8e4-4a48-a5a9-de7091033bfc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:53.123991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.124735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.125171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.156658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:53.159053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:53.207311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:53.208945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.211205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.216071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.238217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:53.241437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:53.278830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:53.280080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:53.281474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:53.281474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:53.281474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:53.281474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:53.285363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 380/763] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:53.290801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:53.311079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:53.326731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 384/764] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:02:53.352201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:53.404066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:53.553729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0374-1a68-4cb1-936b-321bcc31d03a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:53.591902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56773-b722-4463-9ee4-2373e5b68ae0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:53.610624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:53.612189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.612716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.613526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.614502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:53.615217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:53.617238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:53.633822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 381/765] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:53.644506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:53.664207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:53.665645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.666132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.666626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.667898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:53.671072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:53.703848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:53.706514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:53.707355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 385/766] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 15 22:02:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:53.716433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:53.788910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:53.864932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9e035-13cc-455f-a865-6b20d7102e35 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:53.936469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:53.938015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:53.938513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:53.939112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:53.943235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:53.963538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:53.966310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:54.005906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3d75d-67d8-44be-b25c-ef318a22dc8d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:54.017990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:54.019094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:54.020060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:54.020576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 382/767] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:54.026618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.083181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.084365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.084959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.085516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.086467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:54.087072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:54.088792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c6fbc-c593-44c4-bfae-3694881e6061 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:54.095425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 386/768] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 15 22:02:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:54.098609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eea741-0785-4e77-9ae6-00b138fcd59c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.099443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eea741-0785-4e77-9ae6-00b138fcd59c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.099980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eea741-0785-4e77-9ae6-00b138fcd59c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.101810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 387/769] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:54.106879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eea741-0785-4e77-9ae6-00b138fcd59c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.203958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28fdf-fe5c-4f84-a52c-b1da0ca30db4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.242211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:54.251610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.252712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.253267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.253774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.254901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:54.255526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:54.257275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290e89f-1fb6-4ae9-96f0-134e30870b44 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:54.272434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 383/770] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:54.274208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b28e5-7366-457f-b4d8-3195adbf23ad None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.274773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b28e5-7366-457f-b4d8-3195adbf23ad None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.275274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b28e5-7366-457f-b4d8-3195adbf23ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.295070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-468b28e5-7366-457f-b4d8-3195adbf23ad None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:54.296587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eea741-0785-4e77-9ae6-00b138fcd59c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.297048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-468b28e5-7366-457f-b4d8-3195adbf23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:54.340144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.341495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.342034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.342505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.343934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:54.345560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:54.347390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:54.357978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 388/771] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 15 22:02:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:54.360161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.396412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 384/772] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:02:54.396412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674153-a73c-4f49-a3d8-a9a88869031a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.396412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674153-a73c-4f49-a3d8-a9a88869031a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.396412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35674153-a73c-4f49-a3d8-a9a88869031a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.396412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 385/773] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:54.396412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674153-a73c-4f49-a3d8-a9a88869031a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.402000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:54.526102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66d9e3-af6e-433f-8643-9aef41b619ad None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.570221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35674153-a73c-4f49-a3d8-a9a88869031a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.579145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d75426-300b-41e7-a245-2431f9443959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.581475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d75426-300b-41e7-a245-2431f9443959 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.582315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d75426-300b-41e7-a245-2431f9443959 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.583315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d75426-300b-41e7-a245-2431f9443959 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/37af776e1e594cf092bdcb7cf4e86379/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.587514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d75426-300b-41e7-a245-2431f9443959 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=37af776e1e594cf092bdcb7cf4e86379, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:54.589834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d75426-300b-41e7-a245-2431f9443959 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:54.594291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:54.612184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 389/774] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:54 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/37af776e1e594cf092bdcb7cf4e86379/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:54.619430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.619667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.620149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.620430 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.620607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.620714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.621192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.623091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] RBAC: Adding query filter params (interface=public, service_id=ae6d19b75661487f93454463570f938e, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:54.623091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:54.624909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:54.635306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 386/775] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:02:54 2022] GET /identity/v3/endpoints?service_id=ae6d19b75661487f93454463570f938e&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:54.636259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.658959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:54.661946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:54.756756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 390/776] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:02:54.758336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.762780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:54.774612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55778-50e8-4c80-ac3c-925ba0469666 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.822204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.823604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.824030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.824462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.840948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:54.854224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:54.855363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:54.856690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 387/777] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:54.857879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:54.937703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8579bdc-4cff-4a8f-a65b-1a2c95e65d30 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:54.942909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:54.988707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:54.989478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:54.990377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:54.990666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:54.991374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:54.993103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.001393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 391/778] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:02:54 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:55.002323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:55.120999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac46a6-e66c-47c0-97c0-b9e5b4a8fac7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:55.175719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:55.200524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:55.202123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:55.202797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:55.203642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] PATH_INFO: `/v3/services/network` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:55.204498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:55.206489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.225173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7519c-a168-45aa-b0ba-fdff30906186 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:55.251875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:55.253286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:02:55.254415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:55.259690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 388/779] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:54 2022] GET /identity/v3/services/network => generated 88 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:55.268589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:55.271045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:55.271891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:55.272176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:55.272453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:55.273397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:55.273720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:55.275153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.296635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 392/780] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:55.302856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:55.439669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592434b-2067-4a25-aa09-a54a6091a66b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:55.472240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:55.483384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:55.484499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:55.484893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:55.485266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:55.497470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:55.498980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.520320 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54a01f-bbff-4509-836c-585111aad7dc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:55.530086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:55.534333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:55.535219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:55.536091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:55.536091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:55.536091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:55.536091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:55.543486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 393/781] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:55.545133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:55.605815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:55.607019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:55.607504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:55.607973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:55.609088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] RBAC: Adding query filter params (name=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:55.609726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:55.611552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.622859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 389/782] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:55.624662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:55.783406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ff944-ca0c-4f85-a871-552874740f66 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:55.821574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4b910-c6ba-4563-af8f-b76c62884e7d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:55.886525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:55.887745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:55.888235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:55.888717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:55.891589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:55.892205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:55.895003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.896567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:55.897810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:55.898304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:55.898779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:55.900184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] RBAC: Adding query filter params (type=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:55.900707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:55.903728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:55.924507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 390/783] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:55.935495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:55.938931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 394/784] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:55.944418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.023744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:56.055641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:56.128747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b67ccf-889d-40f5-9559-df6980a74f2a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:56.170939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:56.172139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.172775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.173382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.174592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] RBAC: Adding query filter params (interface=public, service_id=768409ca80974a6cb7b78ce60601171a, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:56.175192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:56.176894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e0d5e-88d6-4059-ba35-2362001005c3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:56.177493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10882-ef9d-406f-9e5d-70abc110989b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:56.189353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 391/785] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/endpoints?service_id=768409ca80974a6cb7b78ce60601171a&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:56.191345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd56c9-5686-44d6-bdda-6e80a903efd3 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.191872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd56c9-5686-44d6-bdda-6e80a903efd3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.192451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd56c9-5686-44d6-bdda-6e80a903efd3 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.197476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 392/786] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:56.198823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd56c9-5686-44d6-bdda-6e80a903efd3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.238464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:56.239102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.239553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.240014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.257207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:56.260389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0cf1c952-6b07-4e0c-a996-784d8674c254 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:56.280416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:56.281541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:02:56.282665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:56.289674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 395/787] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:02:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:56.289674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.289674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.289674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.309046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:56.310568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:56.379300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:56.386803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd56c9-5686-44d6-bdda-6e80a903efd3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:56.401397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 396/788] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:02:56.402904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.447622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:56.451379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:56.453353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.453921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.454488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.455570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:56.461399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:56.477597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 393/789] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:02:56 2022] GET /identity/v3/services => generated 772 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:56.479061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.553361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e9f53-aa81-41f4-81ab-75b9db1c3acd None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:56.597217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:56.598078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.598381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.598736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.603414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:56.603414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:56.603414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:56.622243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 397/790] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 15 22:02:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:56.628538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.674501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ced72-494f-460d-8f47-a8b01637bd88 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:56.759784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:56.762517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.763200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.764948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.792305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:56.802037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:56.803122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:56.804011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:56.807468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:56.814261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 394/791] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:56.819781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.836712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb3cf-5126-481a-bc0f-4b15c80f7c76 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:56.853096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:56.890239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:56.891311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:56.891613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:56.891984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:56.905405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:56.907120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:56.928745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:56.930665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:56.932016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:56.932016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:56.932016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:56.932016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:56.937823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 398/792] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:56.938949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:56.977029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e5117-5c18-401a-b384-ab4dd59d0cce None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.033561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.034737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.035274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.035718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.037370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:57.038030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.039875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:57.057478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 395/793] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:57.061127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:57.066344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a424e-24c2-44bc-8e76-aac55c725457 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.115909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.116540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.116827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.117126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.119189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:57.119519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.120981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:57.141368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:57.148154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 399/794] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:57.154114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:57.281536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:57.311885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991aa7a-7b38-4785-b87f-8431dd2b8877 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.318832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e597a-706d-4c17-8c81-3b5243240310 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.387400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.388153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.388435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.388708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.395503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.396390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.396675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.396946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.404900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.406655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:57.423539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:57.424721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:57.425861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:57.426403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.427919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:57.428318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 400/795] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:57.434600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:57.471052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:57.472122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:57.473137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:57.473137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:57.473137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:57.473137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:57.475667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 396/796] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:02:57.481765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:57.561876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:57.615702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbce0f6-3cb8-4d99-b51b-628a18fea5c5 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.662532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.664530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.665007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.665551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.666636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:57.667098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.668921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cbc84-7f8c-4cd8-b419-1b34c8bb4a96 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:57.688108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 401/797] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:57.700218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd942a-c637-4621-b206-60f49c721c1e None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.701274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd942a-c637-4621-b206-60f49c721c1e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.701796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd942a-c637-4621-b206-60f49c721c1e None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.704446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 402/798] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:57 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:57.705600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd942a-c637-4621-b206-60f49c721c1e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:57.726989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40366850-1fe7-49ec-bdbf-a5614ba08cf1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.788376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.789217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.789598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.789878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.791517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:57.791517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.793234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9f634-9120-450e-8b97-54ff2b3b23cd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:57.796922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:57.810734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 397/799] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:02:57.812430 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.812716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.812994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.843037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:57.844977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:57.878751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd942a-c637-4621-b206-60f49c721c1e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:57.917747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:57.945425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 398/800] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:02:57.946883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:57.950646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:57.952048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:57.952824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:57.953673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/fb8c1184414947a8ad358a0eb891ba30/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:57.983250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=fb8c1184414947a8ad358a0eb891ba30, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:57.986058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.014385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 403/801] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:02:57 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/fb8c1184414947a8ad358a0eb891ba30/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:02:58.014633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.123072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a7e3c-31a1-4fc9-875e-77dbfbfebdd7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.166827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:58.175784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57fd89-1f15-4a44-925f-b5d93ed37e0b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.190006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.196026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.197840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.198233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.213450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:58.216171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-45d5dd8c-17fb-4925-a09b-a283a91297d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:58.252454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:58.253570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:58.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 399/802] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:58.255846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5d12-094d-4fc3-846a-efd8a1e052fb None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.255846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5d12-094d-4fc3-846a-efd8a1e052fb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.256130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca5d12-094d-4fc3-846a-efd8a1e052fb None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.261387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 400/803] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:58.261613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5d12-094d-4fc3-846a-efd8a1e052fb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.265701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e081340-6f83-4d5a-aef7-1b6ff457444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.266588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e081340-6f83-4d5a-aef7-1b6ff457444d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.266875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e081340-6f83-4d5a-aef7-1b6ff457444d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.267156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e081340-6f83-4d5a-aef7-1b6ff457444d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.282082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e081340-6f83-4d5a-aef7-1b6ff457444d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-4e081340-6f83-4d5a-aef7-1b6ff457444d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:02:58.290529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:58.291562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:58.292702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 404/804] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:58.297781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.298135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.298437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.321396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:58.321396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:02:58.359595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:58.415797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca5d12-094d-4fc3-846a-efd8a1e052fb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.421421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 405/805] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:02:58.429439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.476552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.476552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.476860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.477485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.479246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:58.479887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:58.483119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.524355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 401/806] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:58.529978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.587790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:58.609813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a58b-566c-4992-b615-eb6e78dac5a7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.657023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08debd-f28e-4f73-b47d-93dbb13430a2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.670662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.672063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.672609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.673158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.674454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:58.675006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:58.676714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.688654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 406/807] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:58.690046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.711401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.712053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.712341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.712614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.713300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:58.714838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.724680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:58.731197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:58.732286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 22:02:58.733185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:58.738505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 402/808] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:58.739711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.823977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8539c1-c466-47ad-8fed-532f95776abf None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.865085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc936f92-0027-4000-9074-b8de97043f07 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:58.866107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.867294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.867949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.868473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.877925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:58.893365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:58.895694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:58.918596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:58.919666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:58.920545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:58.920545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:58.920545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:58.920545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:58.923741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 407/809] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:58.924830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:58.932953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:58.934355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:58.934861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:58.935346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:58.955062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:58.957372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:02:58.991694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:58.993019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:58.994184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:02:58.994184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:02:58.994184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:02:58.994184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:59.001884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 403/810] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:59.003418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.027600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:59.065951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24351966-4aa5-4f28-9c87-032dd31882ad None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.126651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.128022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.128592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.129116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.130253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:59.130829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.133111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.139199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb9c7-7995-4fbf-aa30-963404c71f6c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.141455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 408/811] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 15 22:02:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:59.142890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.184040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.185162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.185502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.185786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.186529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:59.186946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.188398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.205626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 404/812] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:59.207507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.236089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:59.331750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416c74b-2e3c-4511-bf76-376faa8b6495 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.348756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433face-a4c6-4197-9ac4-efbd1393bdfa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.383557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.384871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.385206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.385527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.386283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:59.386595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.388320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.398969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:59.402509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.403667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.404274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.404998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.406821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:59.407442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.409828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.412789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 409/813] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:59.413927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.425787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 405/814] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:59.427699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.547456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:59.569501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc09a81-5740-4333-ab9d-7b2554ce0b9a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.570111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff33fa-50a1-4d81-a7db-ca19dda472a6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.623197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.624328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.624505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.624920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.625275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.625628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.626017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.626557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.635595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.635978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.637415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.637584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:02:59.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:59.656260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:02:59.658934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-fb568f57-10be-4811-ae08-a275ae6e753a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:02:59.659808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:02:59.663704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:02:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:02:59.669369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 406/815] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:59.669369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.669696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 410/816] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:02:59.669696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcf87-e981-482f-9f78-e7c8f41faa1e None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.669696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcf87-e981-482f-9f78-e7c8f41faa1e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.669696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcf87-e981-482f-9f78-e7c8f41faa1e None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.671025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 411/817] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:02:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:02:59.671025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcf87-e981-482f-9f78-e7c8f41faa1e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.750136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:59.795225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a388acf-c4eb-4e43-ba9f-34027507fae7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.816422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcf87-e981-482f-9f78-e7c8f41faa1e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:02:59.835320 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.836299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.836741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.837167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.838197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.839903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.857954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:02:59.877365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 407/818] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:02:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:02:59.877365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:02:59.910210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:02:59.911038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.912050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.912341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.914519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:02:59.914952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:02:59.917204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e11c6-351c-4cc6-81db-3962ab26e376 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:02:59.950427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 412/819] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:02:59.955063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:02:59.955403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:02:59.955691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:02:59.985930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:02:59.987944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:00.023816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d28fa-6910-491f-953a-2f3834984c14 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.084150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:00.084942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.085235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.085532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.086436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:00.086905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:00.088605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:00.100741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 413/820] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:02:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:00.101772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:00.105444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 408/821] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:00.119381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:00.154664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:00.219144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:00.237851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0f9d9-d235-465f-99be-ff8d5d48abaf None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.278988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faac78-87dd-4396-9a37-0e53ca62b42b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.282838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14879d2a-98f6-4281-a66a-a6bcad6cdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:00.283766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14879d2a-98f6-4281-a66a-a6bcad6cdcde None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.284229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14879d2a-98f6-4281-a66a-a6bcad6cdcde None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.284660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14879d2a-98f6-4281-a66a-a6bcad6cdcde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.318732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:00.319652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.319977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.320252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f433e4fc095b4c149082b305ea3c625d/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.322490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=f433e4fc095b4c149082b305ea3c625d, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:00.324133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:00.347329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 409/822] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:03:00 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f433e4fc095b4c149082b305ea3c625d/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:03:00.348153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:00.404210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14879d2a-98f6-4281-a66a-a6bcad6cdcde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:00.406531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14879d2a-98f6-4281-a66a-a6bcad6cdcde None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:00.470186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:00.518410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0887369-834e-4f6a-8430-0bfc71b41a69 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.556236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:00.572281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 414/823] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:00.578666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138166ff-e26a-427e-bebc-287e8e863077 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.578958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138166ff-e26a-427e-bebc-287e8e863077 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.579337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138166ff-e26a-427e-bebc-287e8e863077 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.581481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 415/824] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:00.582406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138166ff-e26a-427e-bebc-287e8e863077 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:00.583031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:00.584087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.584557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.585012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] PATH_INFO: `/v3/services/network` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.586391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:00.588048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-08b5d9e4-ef45-40e5-b3eb-f0ebac53b7eb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:00.602807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:00.603803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 22:03:00.604613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:00.607949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 410/825] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:00 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:00.609586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.609909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.610230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.636707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:00.638311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:00.739949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138166ff-e26a-427e-bebc-287e8e863077 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.757544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 411/826] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:00.759018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:00.804225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:00.805640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.806182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.806678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.821367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:00.823321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:00.825935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:00.847702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:00.848702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:00.849627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:00.849627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:00.849627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:00.849627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:00.851851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 416/827] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:00.853386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:00.934325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56f393-14f2-4fb2-8759-79f080531434 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.955350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:00.980492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108e19f-13b2-4180-bc14-730899b82a90 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:00.982692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:00.983424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:00.983812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:00.984132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:00.985045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] RBAC: Adding query filter params (name=network) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:00.985390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:00.986906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:00.997878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 412/828] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:00.998964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.028704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.030125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.030721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.031529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.053778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:01.064992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:01.066133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 417/829] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:01.072949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.148626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:01.155965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7e1c6-9852-4f92-a350-6263be1a4d7f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.213725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.215143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.215824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.216831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.217957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:01.218590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.221018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.257748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 413/830] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:01.258383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f7640-9450-4b3f-a41c-1ef9b3f56e2b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.258744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.302565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.303292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.303579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.303996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.304701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:01.305011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.306614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.311933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:01.314058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 418/831] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:01.316173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.391093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10455b07-f293-4b52-882e-69c509621ce7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.430608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.431034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5028-501b-4412-9a7b-1955c9e126f4 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.431559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.431934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.432306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.433260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:01.433698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.435358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.445807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 414/832] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:01.446885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.452655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:01.474840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.476065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.476538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.477007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.486593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.488407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:01.504422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:01.505645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:01.506531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:01.513421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 419/833] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:01.514636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.562483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:01.568046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57942d8-41cf-42d7-a6e2-9e56303169b6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.608443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.609623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.610162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.610634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.611732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.613383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.642655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54114f80-fb0b-4d99-b888-ced4c4f1bac0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.649356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 415/834] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:01.649356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.758492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.759265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.759545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.759815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.774854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.776491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:01.800238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:01.801199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:01.802135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:01.802135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:01.802135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:01.802135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:01.802135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 420/835] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:01.807545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.845963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:01.897254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc346d4a-3ffd-40d3-bed3-6ecab834d527 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.936842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936053-b204-4aff-a290-28c4d77b9772 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:01.941123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.942147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.942640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.943137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.944125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:01.944627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.946474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:01.961517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 416/836] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:01.967510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:01.987951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:01.988638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:01.988956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:01.989229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:01.990024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:01.990329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:01.991527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:01.992406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.008437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 421/837] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:02.014059 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:02.090034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b81fb4-2452-4430-8246-ea8e0d995d5a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.119780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:02.127814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:02.128492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.128767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.129042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.129973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=37af776e1e594cf092bdcb7cf4e86379) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:02.130290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:02.131883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.138591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 417/838] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:01 2022] GET /identity/v3/role_assignments?user.id=37af776e1e594cf092bdcb7cf4e86379&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:02.143563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea7881-c425-4177-9eac-235c6ccc26a9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.189692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:02.190545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.190830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.191105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.200144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:02.201685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-79efc62e-5991-4137-8bc1-d8b29ba3823c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:02.219544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:02.220726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:02.221902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:02.238143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 422/839] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:02.238561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:02.350224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:02.371963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4f4fd-8eb0-4065-996c-d01086fdb12f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.393680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85160c-07e6-47c0-abb8-6e17562844ec None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.393984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85160c-07e6-47c0-abb8-6e17562844ec None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.394235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85160c-07e6-47c0-abb8-6e17562844ec None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.395614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 423/840] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:02.400924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.401307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.401525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.419290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:02.419979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.420264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.420538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.421484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:02.421822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:02.423355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:02.423472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.424553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:02.447319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 418/841] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:02.453225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:02.521904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 424/842] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:02.544610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:02.572426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63c948-662a-4357-843c-1316c39532a3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.611453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:02.612060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.612337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.612607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.621270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:02.647362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:02.691833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01627c02-b58e-4233-979f-c6f5812d084b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.700353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:02.701981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.737280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:02.738144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.738446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.738881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.739554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:02.741825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-09ace84a-c27a-49fe-acda-e61402bea661 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:02.754637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:02.755813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:02.756929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 425/843] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:02.757870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781de72c-4fd5-4d9b-94d4-26bf8b4b2998 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.757870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781de72c-4fd5-4d9b-94d4-26bf8b4b2998 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.757870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781de72c-4fd5-4d9b-94d4-26bf8b4b2998 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.761516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 426/844] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:02.765164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.765526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.765809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.783558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:02.784770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:02.825855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 419/845] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:02.825855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:02.877498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 427/846] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:02.877498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:02.878252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:02.949869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94af11-661c-4007-b583-dacf17c88a90 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.956300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:02.989898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:02.990584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:02.990870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:02.991143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:02.991855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:02.992161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:02.992965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095eb26f-5255-4507-9504-34d3901ba2fe None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:02.993577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:02.998624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 420/847] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:02.999642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.037106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.038018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.038296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.038564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.050915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.052916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:03.078405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:03.079368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:03.080921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:03.080921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:03.080921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:03.080921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:03.080921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 428/848] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:03.080921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.111775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44b85d-31bd-450c-95aa-023f67e9132f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.113618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:03.151851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.153060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.153607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.154096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.168028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:03.177256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:03.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 421/849] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:03.179339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.198021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4171-d0b9-4761-91a1-d63c7a7ae4d0 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.236859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:03.253912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.254604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.255025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.255491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.256203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:03.256515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.258005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.273511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 429/850] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:03.273511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.319793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6bba0-34f0-4ea0-9898-d4bff2d48e16 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.360784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.361515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.361797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.362069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.362829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:03.363171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.364830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.384981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 422/851] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:03.391439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.407247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd259a93-0717-4622-856e-240e8324d1fd None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.420448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:03.463637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.464457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.464869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.465203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.466097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:03.466468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.468058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.478051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 430/852] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:03.485014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.514058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494f4c-7e86-4f7a-9f25-91c37f01fbf0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.537760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:03.554479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.555536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.555874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.556346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.564030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.565711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:03.581343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:03.582683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:03.583560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 423/853] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:03.588801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.596328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef610d53-3b63-4cb3-8b8a-c716367bc178 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.633202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.634211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.634589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.634926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.647880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.649646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:03.668193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:03.669305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:03.670442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:03.670442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:03.670442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:03.670442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:03.670991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 431/854] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:03.677483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.697976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:03.718911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c3b5-362b-49c4-abd7-666832b7ff87 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.754945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.755771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.756162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.756528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.757501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:03.757908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.759439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.778121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 424/855] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:03.779157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.790950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:03.794935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a29b1-3595-4bd1-9a8f-b7cc9890776b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.835885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.836851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.837142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.837841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.838642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:03.838959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.840930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.863485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 432/856] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:03.864440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:03.902213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24054cae-b7bc-47c6-afaf-1d7a3a9ce38b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:03.948566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:03.949498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:03.949785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:03.950327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:03.951165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=fb8c1184414947a8ad358a0eb891ba30) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:03.951616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:03.953806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:03.962631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 425/857] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/role_assignments?user.id=fb8c1184414947a8ad358a0eb891ba30&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:04.000656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8bb9e-f725-43dc-b836-57a24a3dc0f7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:04.042946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:04.043857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.044188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.044471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.053771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:04.055283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:04.072194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:04.074442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:04.076628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 433/858] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:03:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:04.080563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:04.090160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:04.198250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d518e-e178-4442-aa08-7bcfcdaa15c7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:04.236703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:04.237342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.237627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.237969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.238823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:04.239600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:04.240623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe2153-41f5-4759-bb52-5d5dc2b6bcf9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:04.269366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 426/859] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Jun 15 22:03:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:04.275941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:04.304056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:04.409989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc0dfd-2238-40c9-88ba-8dcec167aebb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:04.452191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:04.453192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.453602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.453884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.473718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41e21-92e3-4565-963a-8787c5537e52 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.474363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41e21-92e3-4565-963a-8787c5537e52 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.474826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41e21-92e3-4565-963a-8787c5537e52 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.480237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 427/860] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:04.482078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.482590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.482918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.503783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:04.505825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:04.531467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:04.533532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:04.562262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:04.670345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 434/861] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:04.678552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:04.724397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:04.737440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 428/862] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:04.759225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:04.801574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ea064-a707-4e2b-b68b-8cc1d043a512 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:04.826070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:04.843457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:04.844694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.844980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.845255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.859476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:04.861365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:04.882897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0f3c-9d2b-4362-a0a6-f3990579293e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:04.884621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:04.885524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:04.886419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:04.886419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:04.886419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:04.886419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:04.889404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 435/863] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:04.892241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:04.929376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:04.930259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:04.930632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:04.930818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:04.931444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:04.932883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:04.946281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:04.947293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:04.948105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:04.952100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 429/864] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 15 22:03:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:04.953595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:05.019459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:05.034905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357860c7-1838-46d7-b3a9-56f67c9ff9ab None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.074395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90edf3-628b-4dc6-abc9-71281452dc7f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.094352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.095431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.095906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.096371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.097926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:05.098695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.100899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.111983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.112394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.112686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.112947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.113678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:05.113980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.115554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.124470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 436/866] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:05.125533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 430/866] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:05.126251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:05.126874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:05.174512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:05.264083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2498c1-29e2-4455-9892-62a353e849cd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.280567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307370c-68b6-4d5a-abf4-adfa286f10f5 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.307304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:05.323592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.324314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.324686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.325035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.325906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:05.326215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.327954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.333924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 431/867] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:05.336128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.337241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.337765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.338190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.346998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.348924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:05.365565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:05.366534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:05.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:05.370771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 437/868] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:05.377185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:05.497439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25247d2e-4acc-4e00-a81b-285d5a6adabd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.543466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.544093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.544405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.544654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.545495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:05.545808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.547365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979c6cd-0042-43f1-9464-4ea0b6d47251 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.561065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 432/869] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:05.567408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:05.634147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb3eb-27ac-4c4e-aeb3-d18588006360 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.634482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb3eb-27ac-4c4e-aeb3-d18588006360 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.634853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb3eb-27ac-4c4e-aeb3-d18588006360 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.636801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 433/870] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:05.642709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951b21-2bfc-4203-8eb0-901d6e6bbb2c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.643119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951b21-2bfc-4203-8eb0-901d6e6bbb2c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.643489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951b21-2bfc-4203-8eb0-901d6e6bbb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.666530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4f951b21-2bfc-4203-8eb0-901d6e6bbb2c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:05.667908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f951b21-2bfc-4203-8eb0-901d6e6bbb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:05.674583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:05.684969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580ece-ed33-4a19-afee-6fc9eeb48d29 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.728859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.729570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.729854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.730130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.730988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f433e4fc095b4c149082b305ea3c625d) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:05.731305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.732784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.745699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 438/871] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:05 2022] GET /identity/v3/role_assignments?user.id=f433e4fc095b4c149082b305ea3c625d&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:05.753737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:05.764432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 434/872] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:05.789883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:05.921220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3432e-28ec-44cc-a935-0f5760e9006f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:05.963327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8100-6704-414e-8e9c-4e9f01c9c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:05.964025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8100-6704-414e-8e9c-4e9f01c9c4a3 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:05.964307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8100-6704-414e-8e9c-4e9f01c9c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:05.964586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8100-6704-414e-8e9c-4e9f01c9c4a3 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:05.965393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8100-6704-414e-8e9c-4e9f01c9c4a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:05.966871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8100-6704-414e-8e9c-4e9f01c9c4a3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:05.985772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 439/873] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:05 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:06.448927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01cb5-063a-4f5d-aab4-82e2128a803a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:06.449298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01cb5-063a-4f5d-aab4-82e2128a803a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:06.449623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01cb5-063a-4f5d-aab4-82e2128a803a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:06.451314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 435/874] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:06.458015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:06.458518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:06.458594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:06.476591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:06.477837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:06.489987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:06.563293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 440/875] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:06.588884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01cb5-063a-4f5d-aab4-82e2128a803a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:06.702278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01cb5-063a-4f5d-aab4-82e2128a803a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:06.740354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:06.741090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:06.741385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:06.741660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:06.753463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:06.761716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:06.763033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:06.764122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 436/876] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 15 22:03:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:06.771821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:06.896140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5083db-d6dc-4548-8b57-988ee02f13d5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:06.955665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:06.957407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:06.958182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:06.958951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:06.960781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:06.961584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:06.964161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:06.985478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 441/877] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:03:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:06.993973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:07.049741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:07.112538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f47a64-18bf-404f-bf7d-8337471baba8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:07.147854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:07.148691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.148969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.149242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.163113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:07.164632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:07.183171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:07.184146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:07.185009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:07.185009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:07.185009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:07.185009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:07.189267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 437/878] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:07.190859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:07.200528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:07.308154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a31e1-2a6a-4d3e-beb2-9dc0a94f7958 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:07.344184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:07.344873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.345157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.345467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.346270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:07.346586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:07.348046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:07.361713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 442/879] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:07.367068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:07.460897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:07.477040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167854-28c7-40f7-9ae0-f0cda6f9ea49 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:07.511980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:07.512806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.513080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.513374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.521812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:07.523324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:07.538973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:07.539985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:07.540890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:07.544944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 438/880] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:03:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:07.546501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:07.612254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:07.652623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75751546-88fe-4f56-9659-500cfa17a7a8 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:07.694111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:07.694821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.695102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.695374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.696230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:07.696546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:07.698057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0174e9-8ce1-4d60-a1f0-879bafb0c15a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:07.723260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 443/881] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 15 22:03:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:07.724659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:07.743177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694da73-fd77-46b9-b185-530b8641db5c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.743619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694da73-fd77-46b9-b185-530b8641db5c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.743723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694da73-fd77-46b9-b185-530b8641db5c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.745470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 444/882] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:07.751000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.751287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.751565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.770345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:07.771920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:07.855081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df344-ce04-44ab-803b-a20938d27957 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:07.857412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 445/883] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:07.874567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:07.899553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:07.900698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:07.901566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:07.902083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:07.930948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:07.941377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:07.993279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967739c5-695b-4370-8f48-0524beb595d2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:07.998711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.000828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.043634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b6838-1356-4de1-bbd8-a71e5c9e301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.046038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6838-1356-4de1-bbd8-a71e5c9e301b None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.046623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6838-1356-4de1-bbd8-a71e5c9e301b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.047105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b6838-1356-4de1-bbd8-a71e5c9e301b None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.048188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6838-1356-4de1-bbd8-a71e5c9e301b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.049871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b6838-1356-4de1-bbd8-a71e5c9e301b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.068915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 446/884] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:07 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:08.091212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334b2c6-ae68-4ca0-9bff-b9ce7e7c1ff8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.091559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334b2c6-ae68-4ca0-9bff-b9ce7e7c1ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.091773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334b2c6-ae68-4ca0-9bff-b9ce7e7c1ff8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.096249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 447/885] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:08.099105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.099394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.099673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.117498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:08.118720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:08.141035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 439/886] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:07 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:08.146829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.228261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:08.242938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 448/887] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:08.269002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.315399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:08.315884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4af0d-1905-4001-b780-cce8205bd29c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.352649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.353489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.353772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.354046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.364586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.366074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.382210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977951-6ebe-4252-8cb9-7736643a9866 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a3c6167c-a4d4-455a-a587-5c4f96db9e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:08.384972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:08.385869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:08.386752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:08.386752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:08.386752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:08.386752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:08.386752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 440/888] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:08.387513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cbc7-4b77-4348-8503-17e693ccc3a4 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.387795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cbc7-4b77-4348-8503-17e693ccc3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.388071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cbc7-4b77-4348-8503-17e693ccc3a4 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.393447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 441/889] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:08.394278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cbc7-4b77-4348-8503-17e693ccc3a4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.427185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.428257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.428544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.428820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.429954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.431517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-f547bca9-c106-42b3-8c7d-995fe92e95a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:08.444400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:08.445535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:08.454410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 449/890] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:08.455225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.455225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.455225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.475207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:08.477160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:08.516560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:08.520999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cbc7-4b77-4348-8503-17e693ccc3a4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.561048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.561830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.562074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.562353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.563082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:08.563395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.564887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.581895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 442/891] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:08.581895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.591852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 450/892] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:08.592717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.631082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:08.708358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdef1c-ca13-4284-9d7a-190fc360541a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.708652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3350c-f168-4c38-9d22-6231c31d8315 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.746419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.747393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.747673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.747949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.748661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:08.748974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.750426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.750554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.751239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.751573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.751799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.760674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 443/893] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:08.760674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.762194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.763735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:08.779025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:08.779936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:08.780920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 451/894] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:08.781431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.793210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:08.878027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1026c-645f-44a2-a761-9507c00cf288 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.889883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:08.901305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419c6c7-c14e-4536-b3bd-175e623bb493 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:08.918919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.919736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.920017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.920291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.921512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.922508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:08.934743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:08.935739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:08.936773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 444/895] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:08.937627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:08.945419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:08.946118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:08.946402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:08.946677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:08.947403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:08.947716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:08.949100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:08.954355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 452/896] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:08.955199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:09.075619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:09.080212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebeb96-a7c1-49af-b7c7-06ba34d8201b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:09.096825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ac8a-afeb-4e16-a919-fe3d853654e6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:09.120972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:09.121829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:09.122116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:09.122395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:09.123327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:09.123641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:09.125711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:09.133492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 453/897] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:09.139154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:09.152172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:09.153175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:09.153657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:09.154648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:09.155770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:09.156402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:09.158839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:09.169811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:09.180918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 445/898] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:09.189158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:09.277725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7e762-d1b5-4fbf-bdbf-ed8c77e3e62d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:09.317734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:09.318251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36022-7bed-41af-a8c9-745dce5dda07 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:09.318591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:09.318937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:09.319273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:09.320117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:09.320483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:09.322582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:09.328305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 454/899] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:09.333707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:09.366161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:09.367413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:09.368061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:09.368515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:09.370146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] RBAC: Adding query filter params (role.id=4b7f458ff95746579a33e49826dabb89, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=fb8c1184414947a8ad358a0eb891ba30) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:09.370642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:09.372463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:09.380405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 446/900] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:09 2022] GET /identity/v3/role_assignments?user.id=fb8c1184414947a8ad358a0eb891ba30&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=4b7f458ff95746579a33e49826dabb89 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:09.446217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:09.457099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd39e6-8397-4c80-8180-0cce636a0cd9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:09.496863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:09.497934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:09.498365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:09.498789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:09.499834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] RBAC: Adding query filter params (interface=public, service_id=32411d518ed64c369f8916a83f1a29a8, region_id=RegionOne) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:09.500309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:09.501934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2e0e5-cc6e-47fb-ae28-120bee1040fd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:09.511737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 455/901] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:03:09 2022] GET /identity/v3/endpoints?service_id=32411d518ed64c369f8916a83f1a29a8&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:09.517568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:09.537781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:09.640117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34188917-f33a-4253-ae94-35f954d85ac9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:09.674928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774e9a7-f4a3-48b6-b98e-369218d86eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:09.675617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774e9a7-f4a3-48b6-b98e-369218d86eaa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:09.675897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774e9a7-f4a3-48b6-b98e-369218d86eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:09.676170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774e9a7-f4a3-48b6-b98e-369218d86eaa None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:09.676858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774e9a7-f4a3-48b6-b98e-369218d86eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:09.678278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774e9a7-f4a3-48b6-b98e-369218d86eaa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:09.684855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 447/902] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:03:09 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:03:10.406037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead7065-7f2c-4a5c-8b1d-45a61a4f43f8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:10.406568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead7065-7f2c-4a5c-8b1d-45a61a4f43f8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:10.406841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead7065-7f2c-4a5c-8b1d-45a61a4f43f8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:10.408448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 456/903] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:10.414450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:10.414914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:10.414990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:10.432826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:10.434061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:10.508866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 448/904] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:10.532135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead7065-7f2c-4a5c-8b1d-45a61a4f43f8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:10.652179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead7065-7f2c-4a5c-8b1d-45a61a4f43f8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:10.690754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:10.691997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:10.692483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:10.692959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:10.693862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:10.695483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:10.709045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:10.710134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:10.711124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:10.713701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 457/905] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 15 22:03:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:10.721634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:10.735876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:10.855929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0398c9-a5fc-477a-9288-3b2002340ddb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:10.904276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:10.904939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:10.905244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:10.906021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:10.906886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:10.907192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:10.908670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:10.915115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 449/906] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:10.922418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:10.967543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:11.057359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031aac-278c-4066-b64e-f59f26cccd68 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:11.098028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:11.098028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.098028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.098028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.099261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:11.099261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:11.099702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fee28-6acc-4dd3-83c5-a90af25f4894 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:11.106200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 458/907] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:11.119087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:11.236883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:11.282899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f2fc5-7bd2-484e-8d13-51b3f6fbbe92 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:11.314019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e4e7-5c36-42ea-b12a-17a74a14a899 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.314385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e4e7-5c36-42ea-b12a-17a74a14a899 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.314613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5e4e7-5c36-42ea-b12a-17a74a14a899 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.317538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 459/908] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:11.322240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797aa43-2933-486d-9b83-142b6299722b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.322534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797aa43-2933-486d-9b83-142b6299722b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.322815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797aa43-2933-486d-9b83-142b6299722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.326746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:11.327883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.328424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.328908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.330068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] RBAC: Adding query filter params (interface=public, service_id=80137e9d6b45418aac05fb52e65f61e9, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:11.330594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:11.332262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:11.340121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 450/909] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:03:11 2022] GET /identity/v3/endpoints?service_id=80137e9d6b45418aac05fb52e65f61e9&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:11.350652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c797aa43-2933-486d-9b83-142b6299722b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:11.350652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c797aa43-2933-486d-9b83-142b6299722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:11.351064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:11.481379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 460/910] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:11.496318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784cc5c-7526-4ff6-80fe-e3f16c70df2c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:11.506146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797aa43-2933-486d-9b83-142b6299722b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:11.515607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:11.551267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0150a9-99cf-4721-9fad-45f43d3818d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:11.552074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0150a9-99cf-4721-9fad-45f43d3818d2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.552517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0150a9-99cf-4721-9fad-45f43d3818d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.552916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0150a9-99cf-4721-9fad-45f43d3818d2 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.553875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0150a9-99cf-4721-9fad-45f43d3818d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:11.556498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0150a9-99cf-4721-9fad-45f43d3818d2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:11.558429 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:11.568488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 451/911] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:03:11 2022] GET /identity/v3/services => generated 1268 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:03:11.664629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797aa43-2933-486d-9b83-142b6299722b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:11.718191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d30fc-3262-4805-8fcd-b072a169a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:11.719098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d30fc-3262-4805-8fcd-b072a169a777 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.719414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d30fc-3262-4805-8fcd-b072a169a777 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.719691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d30fc-3262-4805-8fcd-b072a169a777 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.720469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d30fc-3262-4805-8fcd-b072a169a777 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:11.721995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d30fc-3262-4805-8fcd-b072a169a777 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:11.738991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 461/912] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:11 2022] POST /identity/v3/services => generated 241 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:03:11.850889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b618a6-173b-4eb9-b492-cf62f9f8c591 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.851239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b618a6-173b-4eb9-b492-cf62f9f8c591 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.851435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b618a6-173b-4eb9-b492-cf62f9f8c591 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.853310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 452/913] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:11.860245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368862d-eb63-426c-abee-7f67a1ec5998 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:11.860592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368862d-eb63-426c-abee-7f67a1ec5998 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:11.860800 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368862d-eb63-426c-abee-7f67a1ec5998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:11.884023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-3368862d-eb63-426c-abee-7f67a1ec5998 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:11.885304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3368862d-eb63-426c-abee-7f67a1ec5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:11.968637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:11.987951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 462/914] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:12.012670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b618a6-173b-4eb9-b492-cf62f9f8c591 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.054903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7aba-8245-4a6a-ad11-ffca1a7404d8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.055529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7aba-8245-4a6a-ad11-ffca1a7404d8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.056016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f7aba-8245-4a6a-ad11-ffca1a7404d8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.058302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 463/915] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:12.066226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.066760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.067263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.086228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:12.087793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:12.158525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b618a6-173b-4eb9-b492-cf62f9f8c591 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.209375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 464/916] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:12.214505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.215873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.216481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.217258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.242403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.248739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:12.259507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:12.260724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:12.261669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:12.264221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 453/917] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:12.272200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.356514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:12.374295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586433a-f583-4a5a-a56b-efb4c2b97e8d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.410643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:12.419473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d032c5-6703-42d9-b257-45004bc9152e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.430737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.431990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.432818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.433471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.434801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:12.438667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:12.455540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:12.456727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 22:03:12.457774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:12.461596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 465/918] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:12.468471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.476651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.477683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.478128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.478537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.479447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:12.479892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:12.481486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:12.500307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 454/919] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:12.502409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.616848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d46b29-c488-4d45-9e90-d14f73ee8cb1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.650175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44745e-a5e7-4d51-90bd-448527b57add None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.660280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.661731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.661984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.662354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.663176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:12.663581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:12.665077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:12.675692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 466/920] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:12.677045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.677962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:12.697223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.698374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.699056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.699482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.714342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:12.716087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:12.740322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:12.741343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:12.742242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:12.742242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:12.742242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:12.742242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:12.744373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 455/921] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:12.753579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.757315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:12.832561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0a433-2455-4760-a9b7-7b494fd20013 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.885792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.886974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.887650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.888064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.889763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:12.890230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:12.892777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:12.894653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a6b86-20a9-4685-9dd5-46205f028450 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:12.900170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 467/922] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:12.906976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:12.942321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:12.943011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:12.943294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:12.943599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:12.944427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:12.944740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:12.946176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:12.973374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 456/923] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:12.974351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:13.016649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:13.042143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5ba54-61ab-4980-840d-db65d7eda825 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:13.060832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:13.085924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:13.086606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.086887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.087164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.088019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:13.089569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:13.111183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b49f3-5bf8-468a-bac0-659c26b96936 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:13.117372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 468/924] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:03:13.173290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:13.174379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.174663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.174936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.185024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:13.186860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:13.205647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:13.207643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:13.210788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 457/925] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:03:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:13.224191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:13.407797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0832-020f-4420-9d05-a791de3b476a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:13.450719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:13.451821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.452347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.452943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.454851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:13.455360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:13.457961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:13.486108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 469/926] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 15 22:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:13.491791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:13.589027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:13.603286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45274-0417-45c9-bf94-4b0ce8d0ec11 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:13.639274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:13.640810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.641091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.641385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.651907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:13.653402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:13.673151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:13.674123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:13.674998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:13.674998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:13.674998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:13.674998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:13.674998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 458/927] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:13.681189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:13.712621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:13.800874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2787f-7baa-45ef-9407-c2b9f10606e2 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:13.843293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:13.844163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.844451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.844732 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.845528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:13.845845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:13.847285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dddcb3-8f82-4fdf-8658-a0dc3713c06f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:13.861283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 470/928] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:13.867074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:13.946635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c1b0-ed2a-49e3-9606-efcb15921e47 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.947003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c1b0-ed2a-49e3-9606-efcb15921e47 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.947207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c1b0-ed2a-49e3-9606-efcb15921e47 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.948741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 471/929] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:13.957143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:13.957502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:13.957749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:13.980656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:13.982199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:13.997688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93382cd-8a59-4c7c-ab91-d21da260ed19 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.041736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.042554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.042838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.043115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.052184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.054013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.057336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:14.073290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:14.074259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:14.075133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 459/930] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:14.085418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.085573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 472/931] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:14.103173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.127109 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:14.228452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0260607-a730-4e4f-af88-16bb1f759120 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.267622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbe4d6-89fa-4809-80b1-fdd111a9bf2d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.268368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.269239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.269553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.269829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.270801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:14.271119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.272856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2de9c-9f4b-45ac-ab01-997e55e328a5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.289401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 460/932] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:14.289401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22aab5-bc0e-4b06-9ba8-3afc408195e2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.289401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22aab5-bc0e-4b06-9ba8-3afc408195e2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.289401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22aab5-bc0e-4b06-9ba8-3afc408195e2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.290158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 461/933] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:14.294025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22aab5-bc0e-4b06-9ba8-3afc408195e2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.316054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.317138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.317460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.318172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.318847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.320656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-ccd0394e-b64d-48db-b25a-4c874344aa37 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:14.335696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:14.336703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 22:03:14.337992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:14.339403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 473/934] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jun 15 22:03:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:14.340848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.341216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.341608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.359516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:14.360884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:14.381391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:14.430501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22aab5-bc0e-4b06-9ba8-3afc408195e2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.456199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 474/935] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:14.459807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.476303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.477372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.477727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.478102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/fb8c1184414947a8ad358a0eb891ba30/roles/4b7f458ff95746579a33e49826dabb89` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.481188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=fb8c1184414947a8ad358a0eb891ba30, role_id=4b7f458ff95746579a33e49826dabb89)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.482819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.492206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:14.506168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 462/936] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:03:14 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/fb8c1184414947a8ad358a0eb891ba30/roles/4b7f458ff95746579a33e49826dabb89 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:03:14.507811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.651885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa09a-e709-46c8-8cfe-1f87bdc16af1 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.674639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5996-caa4-4618-85e8-a615dd1a10fd None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.700833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:14.708037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.708740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.709029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.709308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.710166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:14.710381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.711801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.717619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.719148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.719526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.719895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.720299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 475/937] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:14.725174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.726124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.727147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:14.753443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:14.754701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:14.755748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:14.759948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 463/938] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:14.761317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.813610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:14.839193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897d8f-ed29-4159-b745-30a9ce20a20e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.877670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.878643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.879073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.879524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.880444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:14.880946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.882587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.888825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 476/939] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:14.897468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:14.941508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc65-ec38-4714-bc7a-e8e878c386c2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:14.989026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:14.989795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:14.990075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:14.990342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:14.991058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:14.991362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:14.992746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:14.998549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 464/940] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:15.004557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:15.033671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa1ace-ad13-41d4-9d77-0bcc4fa2a745 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:15.061133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:15.078330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:15.079092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.079375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.079647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.080424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:15.081879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:15.091658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:15.117971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 477/941] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:15.123734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc40f8b-0463-4ba0-9c4d-3099745d6a58 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:15.172735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:15.173831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.174299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.174753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.175706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:15.176257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:15.177984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:15.189503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 465/942] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:15.194559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:15.332032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17386a-9300-4ec4-8002-1bd105bef4b8 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:15.374827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:15.375549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.375833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.376117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.376993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] RBAC: Adding query filter params (interface=public, service_id=c24f0a09ccfd4851bb6008ee1779a53a, region_id=RegionOne) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:15.377317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:15.378793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587a927-8d51-4afc-8395-7c6afe4e7010 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:15.385316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 478/943] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:03:15 2022] GET /identity/v3/endpoints?service_id=c24f0a09ccfd4851bb6008ee1779a53a&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:15.391525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:15.541298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efcf01-4187-4c28-865a-482567eab835 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:15.561262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:15.605898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:15.606422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b824b8-e224-4dd3-8a00-bd4a0598d07d None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.606550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.606722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b824b8-e224-4dd3-8a00-bd4a0598d07d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.606871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.607012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b824b8-e224-4dd3-8a00-bd4a0598d07d None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.607107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.607795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:15.608712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 479/944] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:15.609579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:15.614895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.615253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.615617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.616707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 466/945] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:03:15 2022] GET /identity/v3/services => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:03:15.635318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:15.636677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:15.747463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:15.769191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 480/946] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:15.804644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:15.950193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782273ea-416d-46fc-ab0c-fab29357d64a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:15.992161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:15.992865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:15.993209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:15.993548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:15.994362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:15.996505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:15.998187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING keystone.server.flask.common [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 22:03:16.028826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.sql.core [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 22:03:16.028826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 22:03:16.028826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [parameters: {'id': '6bd9193a89834e66a2d946973ccc1dec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 22:03:16.028826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6bd9193a89834e66a2d946973ccc1dec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6bd9193a89834e66a2d946973ccc1dec. Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 22:03:16.052048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 15 22:03:16.052963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application yield resource Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise self.value Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application session.commit() Jun 15 22:03:16.054006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.flush() Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application compat.raise_( Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 22:03:16.055589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 22:03:16.056866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 22:03:16.058092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [parameters: {'id': '6bd9193a89834e66a2d946973ccc1dec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:16.059435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:16.060508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6bd9193a89834e66a2d946973ccc1dec. Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:16.066178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 467/947] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jun 15 22:03:15 2022] POST /identity/v3/projects => generated 262 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:16.067072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:16.206166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8870a5-d2ad-42e9-b36d-ecd2b48f79c8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:16.253792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:16.254620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:16.254901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:16.255173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:16.262763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:16.264261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c0f36184-cc0c-4580-962f-c29de22d53de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:16.279373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:16.280415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:16.281286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 481/948] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:16.289166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:16.337902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:16.409055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e4924-4f6c-43fe-b50e-f29d4d57f658 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:16.447011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:16.448088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:16.448575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:16.449045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:16.450085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:16.450595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:16.452544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b7c9fb-13ef-445c-9922-4507ee9c36e1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:16.475666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 468/949] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:16.819108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5e30-ade7-481e-a58a-8a5a9f3553d4 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:16.819629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5e30-ade7-481e-a58a-8a5a9f3553d4 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:16.819629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a5e30-ade7-481e-a58a-8a5a9f3553d4 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:16.821359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 482/950] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:16.827673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:16.828212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:16.828212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:16.846081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:16.847683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:16.928415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 469/951] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:16.952563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5e30-ade7-481e-a58a-8a5a9f3553d4 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.008005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:17.079767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a5e30-ade7-481e-a58a-8a5a9f3553d4 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:17.118621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:17.119467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.119751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.120025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.132526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:17.140872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:17.141850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:17.142852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 483/952] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 15 22:03:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:17.148966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.173152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:17.277070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a267c1-2a1a-41f8-afbd-bc09894819a3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:17.314505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:17.315597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.316100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.316570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.317569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:17.318104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:17.319699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d9e5-126f-41ec-947d-0c7a4b5f8a98 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:17.330275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 470/953] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:17.336012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.451017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f6c4-4428-4f4d-9d9e-8da78402e76b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:17.463372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:17.492289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:17.493108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.493415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.493700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.505127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:17.506638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:17.528494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:17.529536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:17.531098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:17.531098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:17.531098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:17.531098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:17.531098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 484/954] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:17.534853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584534b-e837-4e45-a688-5cb803dc86b9 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.535386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584534b-e837-4e45-a688-5cb803dc86b9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.535719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584534b-e837-4e45-a688-5cb803dc86b9 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.537700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 471/955] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:17.538275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.542578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.542867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.543145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.561307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:17.562580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:17.649451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 472/956] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:17.665013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.680319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:17.686189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012953e-985b-45dc-992a-67f56c650cfb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:17.723994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:17.725006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.725630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.726087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.727129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:17.727624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:17.729233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:17.746888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 485/957] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:17.754448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.791555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:17.802667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f967628-fee4-4f0d-9c1b-9f4739c9398f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:17.852473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:17.854227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.854754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.855265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.856094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:17.859091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:17.877708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:17.879989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:17.881921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:17.883667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cb24b-04b6-49dc-9aa2-48e1041ec3d3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:17.887264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 473/958] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:17.896957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:17.923036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:17.923887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.924161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.924436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.932833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:17.934343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-9fe25d12-0009-4c36-a90c-5bcddcd6c1b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:17.950938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:17.953018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 22:03:17.955995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:17.957797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 486/959] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:17.959012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b70a4-b5ce-484c-b415-31f5be148b98 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:17.959299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b70a4-b5ce-484c-b415-31f5be148b98 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:17.959577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b70a4-b5ce-484c-b415-31f5be148b98 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:17.960943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 487/960] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:17.961678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b70a4-b5ce-484c-b415-31f5be148b98 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.030057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:18.059659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:18.069536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0593e-bdda-4b70-b740-e4272da58ca6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.084682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b70a4-b5ce-484c-b415-31f5be148b98 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.114167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.114858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.115123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.115402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.116120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:18.116439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.117847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a46c5-a078-4ac3-bac7-3e8d453456b5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.125042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 474/961] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:18.126924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.127212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.127493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.135094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.135788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.136064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.136334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.137187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:18.137591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.139030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.153440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:18.154918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:18.165879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 488/962] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Jun 15 22:03:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:18.167270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.252689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 475/963] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:18.259126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.310020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09c394-117d-4c55-9f9a-14faa49c2c50 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.343565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:18.358000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.359444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.359741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.360017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.360748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:18.361048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.362487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.377817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 489/964] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:18.378835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.383937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:18.416385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30999adc-1c64-4111-9a43-2a2ad46f94a3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.488756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.490589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.490589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.490970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.531591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086fec3-b31a-4839-a4cb-d92135d78c4f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.596519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ad410-44cb-4932-a089-367234317ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.597764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ad410-44cb-4932-a089-367234317ace None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.598036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ad410-44cb-4932-a089-367234317ace None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.598303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ad410-44cb-4932-a089-367234317ace None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.598982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ad410-44cb-4932-a089-367234317ace None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.600376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ad410-44cb-4932-a089-367234317ace None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.600491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.602645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-627ad410-44cb-4932-a089-367234317ace None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:18.614848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:18.615991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:18.616830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 490/965] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:18.623062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ad410-44cb-4932-a089-367234317ace None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.683379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:18.733951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 476/966] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:18.735083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.735619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:18.783884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ad410-44cb-4932-a089-367234317ace None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.840122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.841258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.841888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.842380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.843743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:18.844301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.846910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.855815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 491/967] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:18.862349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.867334 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fd816-c8aa-4518-93ac-c18550e82eab None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:18.922359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:18.923589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:18.924818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:18.925456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:18.942047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:18.944256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:18.969582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:18.970617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:18.971479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:18.971479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:18.971479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:18.971479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:18.978402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 477/968] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:18.979457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:18.988554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574861a5-613b-4120-9c39-aa14b882d3b1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.006374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:19.024510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:19.032045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.032928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.033216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.033604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.034385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:19.034642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.036487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc7032-63e0-4d0e-98ab-6e1c73d96f33 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.045794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 492/969] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:19.047258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e8aee-d766-4de2-b78a-f44eddc4bc54 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.047549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e8aee-d766-4de2-b78a-f44eddc4bc54 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.047823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e8aee-d766-4de2-b78a-f44eddc4bc54 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.049279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 493/970] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:19.054012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e8aee-d766-4de2-b78a-f44eddc4bc54 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.102603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3432dd-f79e-473c-b198-345c81e9e781 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.157816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.158885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.159169 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.159442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.160292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:19.160476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.162760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796cf07-4e85-4f21-b1f9-275c43df96cc None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.177559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e8aee-d766-4de2-b78a-f44eddc4bc54 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.179417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 478/971] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:19.180873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.181155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.181451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.205368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:19.206844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:19.219690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.220759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.221192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.221625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.224774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.224774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.250721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 494/972] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:19.258475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.317667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 479/973] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:19.345147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.361628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:19.377754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:19.441664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e43f41-46c7-4f41-b12f-1d2eeb361f3e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.483823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.484728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.485014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.485470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.495450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.497270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:19.515524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:19.517138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:19.518201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 495/974] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:19.523355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.545916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d77dc-e64e-4e94-b0c2-9c1611a79fb5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.595691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.596960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.597251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.597580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.598323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.600154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.619618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.sql.core [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 22:03:19.619618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 22:03:19.619618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [parameters: {'user_id': 'dc4a11683fc7419eab55d1f1fcea9537', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 22:03:19.619618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 15 22:03:19.629427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 22:03:19.630363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application yield resource Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application next(self.gen) Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise self.value Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application session.commit() Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 22:03:19.631294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.session.flush() Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application compat.raise_( Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 22:03:19.632252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 22:03:19.633129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application conn.query(q) Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application result.read() Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 22:03:19.634028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dc4a11683fc7419eab55d1f1fcea9537', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:19.634851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 15 22:03:19.635701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:19.636580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 480/975] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jun 15 22:03:19 2022] POST /identity/v3/users => generated 160 bytes in 287 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:19.640423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.666950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316ccd3-ca22-486e-b596-cc9ec1012148 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.684213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:19.711138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.712146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.712604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.713042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.714034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:19.714498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.716370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.730445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 496/976] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:19.737952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:19.739506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.790231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff95d9-2288-4828-b2db-7121249b2491 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.846844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.847761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.848407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.848783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.862843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.867815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.885467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7b86a-3faf-4e66-8787-29113972f8a9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:19.895297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:19.896306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 22:03:19.897255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:19.897894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 481/977] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:03:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:19.904596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:19.936894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:19.938057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:19.938610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:19.939108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:19.940262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] RBAC: Adding query filter params (role.id=4b7f458ff95746579a33e49826dabb89, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=fb8c1184414947a8ad358a0eb891ba30) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:19.940787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:19.942529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0cdc6-50d3-4763-84f7-bcde70e48e6c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:19.950007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 497/978] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:19 2022] GET /identity/v3/role_assignments?user.id=fb8c1184414947a8ad358a0eb891ba30&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=4b7f458ff95746579a33e49826dabb89 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:20.060354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c1ce-8f0d-4768-a5cc-6b0fef4061b0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:20.095446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:20.106123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:20.107231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:20.107748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:20.108773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:20.110165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:20.110709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:20.112456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0519805-e39e-40b1-87d5-79bf2d50f7d1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:20.156832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 482/979] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jun 15 22:03:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:20.652021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ca2c-aba1-43f0-a363-45c58c81bd9c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:20.652556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ca2c-aba1-43f0-a363-45c58c81bd9c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:20.652556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ca2c-aba1-43f0-a363-45c58c81bd9c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:20.653993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 498/980] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:20.660044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835fcef-7319-462f-b2f3-6ea39dee537c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:20.660343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835fcef-7319-462f-b2f3-6ea39dee537c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:20.660622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835fcef-7319-462f-b2f3-6ea39dee537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:20.680723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0835fcef-7319-462f-b2f3-6ea39dee537c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:20.682300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0835fcef-7319-462f-b2f3-6ea39dee537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:20.757930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 483/981] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:20.781052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ca2c-aba1-43f0-a363-45c58c81bd9c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:20.830340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:20.902354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ca2c-aba1-43f0-a363-45c58c81bd9c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:20.940663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d24307-b3de-4920-a4f4-8f617434b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:20.941357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d24307-b3de-4920-a4f4-8f617434b841 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:20.941657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d24307-b3de-4920-a4f4-8f617434b841 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:20.941929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d24307-b3de-4920-a4f4-8f617434b841 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:20.942661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d24307-b3de-4920-a4f4-8f617434b841 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:20.944080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d24307-b3de-4920-a4f4-8f617434b841 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:20.961026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 499/982] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:20 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:21.665934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704618-349b-49eb-ad77-a0b98126cf92 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:21.666465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704618-349b-49eb-ad77-a0b98126cf92 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:21.666465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704618-349b-49eb-ad77-a0b98126cf92 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:21.668048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 484/983] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:21.673604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:21.674054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:21.674129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:21.692134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:21.693317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:21.774074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 500/984] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:21.797822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704618-349b-49eb-ad77-a0b98126cf92 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:21.915350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704618-349b-49eb-ad77-a0b98126cf92 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:21.937694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:21.956261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:21.957085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:21.957380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:21.957653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:21.958306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:21.959677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-24b3cecd-04f9-46dd-9ed1-f5f7ad86c65e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:21.979686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:21.980835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:21.981736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:21.983190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 485/985] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:21.987360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.013883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:22.105867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6abab9-1f54-4df6-b362-8712733c4a6b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.142923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.143603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.143878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.144141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.144843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:22.145154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.146561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfd21c-e3e6-4f65-a5ef-7fb41cb35fe9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.153460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359af48-72eb-4564-8e33-2b9ae914ce22 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.153741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359af48-72eb-4564-8e33-2b9ae914ce22 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.154025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359af48-72eb-4564-8e33-2b9ae914ce22 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.155869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 486/986] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:22.156972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 501/987] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:22.157647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359af48-72eb-4564-8e33-2b9ae914ce22 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.161644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.161936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.162218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.180642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:22.181875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:22.263982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 502/988] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:22.280364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359af48-72eb-4564-8e33-2b9ae914ce22 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.286507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.303471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:22.320711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.321418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.321704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.321978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.322862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:22.322988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.324356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.330256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 487/989] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:22.336100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.388604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:22.395179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe7d7-2ad1-4ac3-876f-754cf5c7c034 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.431005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.431805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.432090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.432354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.433007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.434434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:22.446645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:22.447712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:22.449200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 503/990] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 15 22:03:22 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:22.453960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.457132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786805-603c-4e34-82ce-be7858fc48d9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.497039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.497402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.497654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.497922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.498847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] RBAC: Adding query filter params (interface=admin, service_id=c24f0a09ccfd4851bb6008ee1779a53a, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:22.499157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.500531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.506091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 488/991] 10.222.0.55 () {56 vars in 1249 bytes} [Wed Jun 15 22:03:22 2022] GET /identity/v3/endpoints?service_id=c24f0a09ccfd4851bb6008ee1779a53a&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:22.511842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.543827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:22.565449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357845a-df6a-4c5e-961d-f4e651a3b6b8 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.602015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.602702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.602988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.603334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.604057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] RBAC: Adding query filter params (name=image) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:22.604395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.605839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.611345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 504/992] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:22.616458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:22.627506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70333e-e4b5-4912-92f9-814becbf7441 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.638160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:22.669885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89f5b8-0bb0-4dd0-bc38-4f9437ec4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.670600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89f5b8-0bb0-4dd0-bc38-4f9437ec4b02 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.670903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89f5b8-0bb0-4dd0-bc38-4f9437ec4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.671300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89f5b8-0bb0-4dd0-bc38-4f9437ec4b02 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.671986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89f5b8-0bb0-4dd0-bc38-4f9437ec4b02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.673394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89f5b8-0bb0-4dd0-bc38-4f9437ec4b02 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.680433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 489/993] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:03:22 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:03:22.739477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8880d85-c574-4d14-9b62-a37924c41e98 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:22.780467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:22.781075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:22.781522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:22.781644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:22.782390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] RBAC: Adding query filter params (type=image) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:22.782696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:22.784111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee74b97-17a8-434d-b28d-eaee0039ad8f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:22.790270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 505/994] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:23.135324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3c33-076e-476b-8c5c-95fea7a2f505 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:23.135630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3c33-076e-476b-8c5c-95fea7a2f505 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:23.135793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3c33-076e-476b-8c5c-95fea7a2f505 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:23.137205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 490/995] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:23.142869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:23.143145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:23.143441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:23.161556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:23.162760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:23.164864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:23.241799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 506/996] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:23.264585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3c33-076e-476b-8c5c-95fea7a2f505 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:23.373687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3c33-076e-476b-8c5c-95fea7a2f505 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:23.409293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:23.410134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:23.410452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:23.410664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:23.411696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:23.413065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:23.425613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:23.426641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:23.427474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 491/997] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:23.432877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:23.546223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f3081-b3d7-4159-8d23-fb137b259e88 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:23.585777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:23.586459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:23.586738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:23.587011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:23.587723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:23.588031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:23.589437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:23.599405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 507/998] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:23.600686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:23.640810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:23.712099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b42bf4-e31f-4b36-bb71-47772536d290 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:23.748419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:23.749136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:23.749493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:23.749913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:23.750623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:23.750931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:23.752293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:23.758522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 492/999] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:23.763284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:23.766296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:23.869273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f64b5-e7e6-4040-8f05-824c0074a901 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:23.907573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:23.908241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:23.908522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:23.908797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:23.909662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] RBAC: Adding query filter params (interface=public, service_id=d877a2ba360b4db59596fa75b292e735, region_id=RegionOne) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:23.910002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:23.911831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3b37-ae1a-4031-88f5-3391dcf2ae0d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:23.922126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 508/1000] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:03:23 2022] GET /identity/v3/endpoints?service_id=d877a2ba360b4db59596fa75b292e735&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:23.923813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:24.028703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:24.031510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6f1b-2b88-44eb-ba74-ac7c27021e21 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:24.068156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb33d2-bf70-4c77-87dd-fdc9965f6eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:24.069018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb33d2-bf70-4c77-87dd-fdc9965f6eea None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:24.069304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb33d2-bf70-4c77-87dd-fdc9965f6eea None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:24.069751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb33d2-bf70-4c77-87dd-fdc9965f6eea None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:24.070448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb33d2-bf70-4c77-87dd-fdc9965f6eea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:24.071854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb33d2-bf70-4c77-87dd-fdc9965f6eea None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:24.085460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 493/1001] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:03:23 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:03:24.844254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f62f3e-7378-4e54-a9ac-72cd9b76d849 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:24.844793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f62f3e-7378-4e54-a9ac-72cd9b76d849 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:24.844793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f62f3e-7378-4e54-a9ac-72cd9b76d849 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:24.846409 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 509/1002] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:24.852324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:24.852843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:24.852843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:24.874121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:24.875390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:24.953717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762a698-2a51-4666-b0e0-d0dc9d6a8fe9 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:24.954040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762a698-2a51-4666-b0e0-d0dc9d6a8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:24.954355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762a698-2a51-4666-b0e0-d0dc9d6a8fe9 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:24.955867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 510/1003] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:24.961506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:24.961975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:24.962325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:24.969676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 494/1004] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:24.981958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:24.983247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:24.993091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:25.063047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:25.073261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 511/1005] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:25.096527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:25.115395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:25.124292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4124a-76f8-437c-86c6-57593d943a5e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:25.171646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:25.172779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:25.173058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:25.173475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:25.174181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:25.175575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:25.189798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:25.190994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:25.191933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 495/1006] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jun 15 22:03:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:25.197540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:25.237778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449905fb-5cb7-47b5-b4b3-34dd3938cb96 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:25.284255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:25.284980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:25.285228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:25.285542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:25.286652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:25.288068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:25.304549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 512/1007] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:25 2022] POST /identity/v3/services => generated 242 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:03:25.332451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf73f0-5aac-4daf-bec8-24a9eb02fc16 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:25.379936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:25.380554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:25.380840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:25.381119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:25.381901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:25.382212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:25.383624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:25.394519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 496/1008] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:25.396472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:25.476488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:25.527312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b933fb-7566-4775-b0b4-374435cfefa1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:25.562600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:25.563288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:25.563572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:25.563846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:25.564558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:25.564866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:25.566271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81556f8-c44f-46a1-b5b1-4dbb05dbaa0d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:25.571415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 513/1009] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Jun 15 22:03:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:25.577961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:25.601143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:25.702751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692648-b7c1-44c9-b468-d3f7412e1613 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:25.750202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bafc2-61b9-4695-bcab-e5fd5cdad1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:25.751364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bafc2-61b9-4695-bcab-e5fd5cdad1f7 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:25.751684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bafc2-61b9-4695-bcab-e5fd5cdad1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:25.751960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bafc2-61b9-4695-bcab-e5fd5cdad1f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:25.752718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bafc2-61b9-4695-bcab-e5fd5cdad1f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:25.754144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bafc2-61b9-4695-bcab-e5fd5cdad1f7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:25.777363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 497/1010] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:26.260651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312383a-0efc-4b05-ae0d-009b606edccf None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:26.261462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312383a-0efc-4b05-ae0d-009b606edccf None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:26.261462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312383a-0efc-4b05-ae0d-009b606edccf None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:26.263070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 514/1011] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:26.268780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:26.269613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:26.269613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:26.287649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:26.288859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:26.372625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 498/1012] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:26.395673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312383a-0efc-4b05-ae0d-009b606edccf None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:26.517515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312383a-0efc-4b05-ae0d-009b606edccf None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:26.539600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:26.557092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:26.557933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:26.558227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:26.558506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:26.559169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:26.560569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:26.573234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:26.574484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:26.575420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 515/1013] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:26.581361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:26.583914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:26.692317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fef10-e398-4a65-8524-e9bc2f824a30 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:26.727077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:26.727769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:26.728048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:26.728317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:26.729021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:26.729352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:26.730723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:26.736630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 499/1014] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:26.742207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:26.876853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7961-c655-4a56-b6b2-bfa6c551a093 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:26.934768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:26.935652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:26.936060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:26.936548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:26.937629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:26.938077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:26.939646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d0de5-cdba-4375-9833-82c1c4373299 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:26.950985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 516/1015] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jun 15 22:03:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:26.952277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:27.026954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:27.070995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347084-8dca-4376-9dae-212348b2b773 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:27.106932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bf0a8-93b6-4acf-a7e5-fa0c8e719d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:27.107650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bf0a8-93b6-4acf-a7e5-fa0c8e719d6c None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:27.107956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bf0a8-93b6-4acf-a7e5-fa0c8e719d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:27.108311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bf0a8-93b6-4acf-a7e5-fa0c8e719d6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:27.109056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bf0a8-93b6-4acf-a7e5-fa0c8e719d6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:27.110463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bf0a8-93b6-4acf-a7e5-fa0c8e719d6c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:27.137434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 500/1016] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:27.611301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7eab9-29cf-43df-aa19-c343807e44fc None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:27.611984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7eab9-29cf-43df-aa19-c343807e44fc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:27.611984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7eab9-29cf-43df-aa19-c343807e44fc None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:27.613192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 517/1017] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:27.618919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:27.619403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:27.619403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:27.637304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:27.638535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:27.728421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 501/1018] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:27.752507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7eab9-29cf-43df-aa19-c343807e44fc None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:27.810788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:27.869846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7eab9-29cf-43df-aa19-c343807e44fc None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:27.906253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:27.907062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:27.907352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:27.907623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] PATH_INFO: `/v3/services/image` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:27.908288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:27.909707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-cef56d8e-53d5-4643-8e3d-8a2bf4d7a569 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:27.922771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:27.924009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:27.925016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 518/1019] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 15 22:03:27 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:27.932563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:27.997049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:28.021797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cfcac-38fa-4631-a236-489aa6467e82 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.022070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cfcac-38fa-4631-a236-489aa6467e82 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.022357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cfcac-38fa-4631-a236-489aa6467e82 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.023758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 519/1020] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:28.029110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.029420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.029810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.047798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:28.049006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:28.056293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eec4e-664d-43ea-aeab-e8ac8f08c9ae None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:28.095510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:28.096279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.096554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.096826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.098043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:28.098351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:28.099754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:28.105973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 502/1021] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:28.111496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:28.128206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 520/1022] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:28.151934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:28.199797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:28.247934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fea8a-9521-4427-be9a-26d38b4df8a6 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:28.265670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:28.271527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c203e-3c26-47f6-8437-edd2f06ebbc5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:28.289932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:28.290605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.290880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.291148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.291853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] RBAC: Adding query filter params (type=image) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:28.292153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:28.293553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:28.299845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 503/1023] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:28.305713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:28.317362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:28.318183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.318464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.318853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.320053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:28.321643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:28.328665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 521/1024] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:28.329598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:28.428820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a73fe-9893-4994-a28e-50c74c0d615c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:28.461528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1ebab-1396-423e-ba98-a424670046a5 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:28.473090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:28.474142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.474588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.474842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:28.474972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.476002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] RBAC: Adding query filter params (interface=public, service_id=75bbbc2703b547cb8ab0b7a68ac3a5c5, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:28.476319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:28.477912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:28.483702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 504/1025] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:03:28 2022] GET /identity/v3/endpoints?service_id=75bbbc2703b547cb8ab0b7a68ac3a5c5&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:28.489502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:28.502592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3f11-c265-42c9-984b-b3c167735b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:28.503271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3f11-c265-42c9-984b-b3c167735b81 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.503549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3f11-c265-42c9-984b-b3c167735b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.503822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3f11-c265-42c9-984b-b3c167735b81 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.504540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a3f11-c265-42c9-984b-b3c167735b81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:28.506036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a3f11-c265-42c9-984b-b3c167735b81 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:28.535189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 522/1026] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:28 2022] POST /identity/v3/projects => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:28.543888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:28.615118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9f0bd-6954-4a78-9d9e-37d2ac499f73 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:28.655552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e856d4-6c09-463b-8e20-a4dcf0fc9750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:28.656439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e856d4-6c09-463b-8e20-a4dcf0fc9750 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:28.656868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e856d4-6c09-463b-8e20-a4dcf0fc9750 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:28.656984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e856d4-6c09-463b-8e20-a4dcf0fc9750 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:28.657697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e856d4-6c09-463b-8e20-a4dcf0fc9750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:28.659097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e856d4-6c09-463b-8e20-a4dcf0fc9750 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:28.667224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 505/1027] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:03:28 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:03:29.419707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2837777-3728-48af-a96c-b3cf6e6a2413 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:29.420283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2837777-3728-48af-a96c-b3cf6e6a2413 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:29.420283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2837777-3728-48af-a96c-b3cf6e6a2413 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:29.421957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 523/1028] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:29.427514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:29.427787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:29.428067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:29.446765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:29.447958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:29.524595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 506/1029] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:29.548637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2837777-3728-48af-a96c-b3cf6e6a2413 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:29.657544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2837777-3728-48af-a96c-b3cf6e6a2413 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:29.694003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:29.694827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:29.695104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:29.695374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:29.706403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:29.714341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:29.715395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:29.721307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 524/1030] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 15 22:03:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:29.723855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:29.768291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:29.840775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d2fc6-0674-4d08-ad08-62794d0fa0ee None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:29.876390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:29.877068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:29.877373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:29.877654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:29.878406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:29.878712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:29.880080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:29.888972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 507/1031] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:03:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:29.895141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:29.923666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:30.006738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4f6e9-eb91-41da-baec-51064d524167 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:30.043003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:30.044007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.044292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.044562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.057292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:30.059415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:30.077543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:30.078649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:30.080232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:30.080232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:30.080232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:30.080232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:30.081723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 525/1032] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:30.085461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:30.193816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:30.198588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5916-0fab-44fe-af6d-f5432455d5a2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:30.244425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:30.245106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.245424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.245675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.246426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:30.246735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:30.248122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:30.262465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 508/1033] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:30.269257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:30.358888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:30.397697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c308e83-4ae9-4036-8703-dc8bcfc7af71 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:30.445737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:30.446525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.446730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.447118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.455586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:30.457069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:30.472939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:30.474220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:03:30.475263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:30.477702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 526/1034] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:03:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:30.480347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:30.592277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84251-e6e7-4c78-a0f2-5805d4db92d9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:30.636646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:30.637407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.637702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.637976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.638881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:30.639594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:30.641362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e01b7-ae31-4215-b833-2d4d2f4ba429 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:30.664345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 509/1035] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:03:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:30.670733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:30.738206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba636-a685-45b4-9d4a-b59729715843 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.738928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba636-a685-45b4-9d4a-b59729715843 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.739216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba636-a685-45b4-9d4a-b59729715843 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.740672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 510/1036] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:30.746330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571e54-3603-4958-97df-770d0281d675 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.746615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571e54-3603-4958-97df-770d0281d675 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.746876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571e54-3603-4958-97df-770d0281d675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.775581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bb571e54-3603-4958-97df-770d0281d675 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:30.777215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bb571e54-3603-4958-97df-770d0281d675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:30.796630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:30.828462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f477c1-a002-4284-b5be-679ace4989cb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:30.884005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:30.884663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.885097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.885266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.888176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:30.902580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 511/1037] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:30.907039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d2ab-124b-4c31-98b6-36b3bdd3556b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.907039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d2ab-124b-4c31-98b6-36b3bdd3556b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.907039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d2ab-124b-4c31-98b6-36b3bdd3556b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.909992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 512/1038] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:30.916604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:30.917041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:30.917488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:30.935482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:30.936861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:30.980380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:30.981931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.018849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 513/1039] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:31.019612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.102278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.118737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 527/1040] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 22:03:31.118737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.129972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efbb66-0bb3-490e-b081-fe48448b8d5c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.157351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.171865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.172685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.172961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.173234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.174704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.176357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.178275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 514/1041] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:31.179085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.243214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ab640-64e8-42b6-8ef1-28df4d041625 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.279680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.281091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.281399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.281677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] PATH_INFO: `/v3/services/image` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.282344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.283720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.289450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c78959-7bbc-45ca-8cf5-314015d3808c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:31.295946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:31.297269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:31.298237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 528/1042] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:31.299021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.329522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.330372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.330648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.330906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.341348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.343164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.346019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:31.362702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:31.363875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:31.364863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:31.364863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:31.364863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:31.364863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:31.364863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 515/1043] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:31.364863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.409792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.414418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3579f1-c3ae-4bc9-a649-fb54ed7318eb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.468142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.469098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.469098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.469397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.470120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.471570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.486874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3645a-547d-48d6-922c-385a20ee8b9d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.492754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 529/1044] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:03:31 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:31.493633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.540061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.540840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.541181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.541935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.542218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] RBAC: Adding query filter params (name=image) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:31.542526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.544205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.550882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 516/1045] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:31.559112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.615025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ccd09-88af-40f4-9d1a-2d7bdf37b271 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.627629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.657774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.658470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.658749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.659019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.659863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:31.660170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.661973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.674128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8be37f-0cb7-4ca9-bcb5-043e34e526ac None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.679107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 530/1046] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:31.684208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.702005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.733276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.734955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.735705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.735705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.736228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:31.736507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.738391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.745544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 517/1047] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:31.753034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.801776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b0d08-5e0d-480f-926c-12773e009ff9 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.840248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.841245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.841645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.841929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.849586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.851107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.861490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd634f17-190d-4624-9624-a4decd9e39b0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:31.866442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:31.867516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:31.868551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 531/1048] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:31.873947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:31.901711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:31.917611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:31.918321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:31.918601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:31.918878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:31.919686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:31.921486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:31.947491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 518/1049] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:03:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:03:31.988701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:32.021446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8cfd9-41ff-4543-b52d-cb89deaf6c0d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:32.072771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:32.073404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:32.073686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:32.073958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:32.074872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:32.075187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:32.076639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4517e2-3689-4272-af54-82d079a3c41f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:32.092446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 532/1050] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:32.099277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:32.243666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1413-4cec-414b-9221-5ff3f011fb21 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:32.287458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:32.288119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:32.288394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:32.288664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:32.289552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] RBAC: Adding query filter params (role.id=4b7f458ff95746579a33e49826dabb89, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=37af776e1e594cf092bdcb7cf4e86379) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:32.289844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:32.291309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0d9a-f4e4-4660-b6a9-076b850f62c7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:32.298444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 519/1051] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:32 2022] GET /identity/v3/role_assignments?user.id=37af776e1e594cf092bdcb7cf4e86379&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=4b7f458ff95746579a33e49826dabb89 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:33.713456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6ddf8-8284-44d1-b49b-28134fc26237 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:33.714009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6ddf8-8284-44d1-b49b-28134fc26237 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:33.714009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6ddf8-8284-44d1-b49b-28134fc26237 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:33.715534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 533/1052] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:33.720878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:33.721590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:33.721590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:33.739411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:33.740597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:33.783775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:33.826911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 520/1053] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:33.860396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6ddf8-8284-44d1-b49b-28134fc26237 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:33.985830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6ddf8-8284-44d1-b49b-28134fc26237 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.014909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.022146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee3289-cdff-4d71-aa80-66e8056a24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.022984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3289-cdff-4d71-aa80-66e8056a24a7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.023252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3289-cdff-4d71-aa80-66e8056a24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.023520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee3289-cdff-4d71-aa80-66e8056a24a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.034995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee3289-cdff-4d71-aa80-66e8056a24a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-afee3289-cdff-4d71-aa80-66e8056a24a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:34.042939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:34.043910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:34.044745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:34.049419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 534/1054] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:34.050314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.164171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc997f1d-e1bb-4b1a-86cc-02fc3991d2ce None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.169060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08eb99-0118-41dc-9a52-3bb7765da8d2 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.169413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08eb99-0118-41dc-9a52-3bb7765da8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.169672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08eb99-0118-41dc-9a52-3bb7765da8d2 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.171563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 535/1055] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:34.177077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.177234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.177526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.195268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:34.196482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:34.204532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.205210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.205515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.205787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.206570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:34.206871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:34.208246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:34.222309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 521/1056] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:34.224101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.267737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.283836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 536/1057] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:03:34.306880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.341530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddde0ed-173a-4577-80a1-17be447e89e9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.380462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.381736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.382090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.382363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] PATH_INFO: `/v3/users/31dfcf88e7d84699938e87aecd9a9477` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.397076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] RBAC: Authorizing `identity:get_user(user_id=31dfcf88e7d84699938e87aecd9a9477)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:34.398581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:34.400539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 522/1058] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/users/31dfcf88e7d84699938e87aecd9a9477 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:34.406250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.419339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15df41-d938-4ef4-a3bf-d1f50a212c26 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.450207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.469238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603c7ae-09d3-41d7-8fe0-58840d393958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.469969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c7ae-09d3-41d7-8fe0-58840d393958 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.470251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c7ae-09d3-41d7-8fe0-58840d393958 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.470530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603c7ae-09d3-41d7-8fe0-58840d393958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.529131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.537493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b72fc5-2d8c-4a02-a9bc-34e27bf2241b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.543464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603c7ae-09d3-41d7-8fe0-58840d393958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:34.544943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603c7ae-09d3-41d7-8fe0-58840d393958 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:34.571564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5edc5-4cfc-45bb-b297-48ebc19ecc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.572226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5edc5-4cfc-45bb-b297-48ebc19ecc7b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.572506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5edc5-4cfc-45bb-b297-48ebc19ecc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.572777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5edc5-4cfc-45bb-b297-48ebc19ecc7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.641936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5edc5-4cfc-45bb-b297-48ebc19ecc7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:34.643393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5edc5-4cfc-45bb-b297-48ebc19ecc7b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:34.646585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 537/1059] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 22:03:34.647957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a33a-b127-4ded-b6aa-74dbbe104de8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.648237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a33a-b127-4ded-b6aa-74dbbe104de8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.648509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642a33a-b127-4ded-b6aa-74dbbe104de8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.649827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 538/1060] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:34.652613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642a33a-b127-4ded-b6aa-74dbbe104de8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.675281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.740975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.749202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 523/1061] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 22:03:34.750541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.750824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.751097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.761692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642a33a-b127-4ded-b6aa-74dbbe104de8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.768264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:34.769556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:34.798371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.799111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.799375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.799669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.810160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:34.811657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:34.829745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:34.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:34.831873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:34.831873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:34.831873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:34.831873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:34.831873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 539/1062] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:34.834572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.841982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 524/1063] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:34.843144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:34.911914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:34.950560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab35d52-aa0d-4eb9-aa87-c809177967b8 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.973895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a99ba-52bd-4c49-a38e-a83533f2c671 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:34.985777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:34.986654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:34.986933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:34.987203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:34.988377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] RBAC: Authorizing `identity:get_project(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:34.989870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:34.991589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 540/1064] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:34.992345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:35.004502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:35.016180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.016850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.017129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.017436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.018183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:35.018642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:35.020667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:35.033164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 525/1065] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:35.034298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:35.104935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926c21a-79ae-4f09-9a8a-1574ca5916ce None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:35.146356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.147229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.147512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.147785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.157828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:35.162256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:35.165682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa5cd0-5554-4fb1-9775-b47e7cb9a5c7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:35.171709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:35.172748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:35.173643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 541/1066] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 15 22:03:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:35.179651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:35.211582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.212257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.212541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.212815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.213695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2, user.id=31dfcf88e7d84699938e87aecd9a9477) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:35.214008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:35.215465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:35.223106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 526/1067] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:35 2022] GET /identity/v3/role_assignments?user.id=31dfcf88e7d84699938e87aecd9a9477&scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:35.310360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b79fa-7321-48e6-836c-1d1014340fb7 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:35.349594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.350578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.350866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.351145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.351924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:35.352241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:35.353718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:35.364348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 542/1068] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:03:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:35.370123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:35.426151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:35.482448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696ab45-d7f6-4319-b1b4-eff0d7be8941 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:35.519326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.520119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.520394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.520660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.532073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:35.533548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:35.552024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:35.553001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:35.554433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:35.554433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:35.554433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:35.554433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:35.554433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 527/1069] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:35.559112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:35.626081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:35.669235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870f961-6140-469c-b697-612ad58ebc71 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:35.707735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.708413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.708698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.708972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.709732 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:35.710038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:35.711424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:35.725009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 543/1070] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:35.730710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:35.839729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:35.843297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51ba2a-b027-4b5f-bde1-2d6e9651437e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:35.877424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:35.878180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:35.878461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:35.878729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:35.886625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:35.888070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:35.902513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:35.903496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:35.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 528/1071] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:03:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:35.909969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:36.011664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f0514-bc04-481d-9b03-12a545701497 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:36.034875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:36.047229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:36.047903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:36.048183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:36.048453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:36.049290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:36.049633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:36.051105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:36.068156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 544/1072] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:03:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:36.073921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:36.180213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b59ed0-ef32-499e-947c-19b55420fd85 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:36.216673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:36.217673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:36.218363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:36.218636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:36.231136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:36.232649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:36.251145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:36.252212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:36.253230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:36.253230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:36.253230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:36.253230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:36.253230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 529/1073] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:36.258293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:36.367763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be8f3-5f5c-4b52-a0c1-a2c50e3003ad None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:36.401939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:36.402612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:36.402873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:36.403144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:36.403870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:36.404177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:36.405639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:36.417486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 545/1074] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:36.423494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:36.441306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:36.531873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc8429-4bcf-4344-8e86-c29b2108138d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:36.570051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:36.570882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:36.571152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:36.571393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:36.578925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:36.580370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:36.594687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:36.595690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:36.596595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 530/1075] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:36.602058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:36.645914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:36.712348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a3d5-f1b7-4a18-9c68-133e674ad1b3 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:36.748921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:36.749631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:36.749913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:36.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:36.750988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:36.751391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:36.752847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f8334-32f4-4723-b3e7-d4241a23d88c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:36.765615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 546/1076] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:36.771696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:36.845692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:36.876804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1038c-cf97-45f2-bff5-189c44eee3ed None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:36.912651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744059-091c-46fe-8594-de8a687d02a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:36.913581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744059-091c-46fe-8594-de8a687d02a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:36.913853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744059-091c-46fe-8594-de8a687d02a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:36.914116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744059-091c-46fe-8594-de8a687d02a2 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/37af776e1e594cf092bdcb7cf4e86379/roles/4b7f458ff95746579a33e49826dabb89` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:36.916597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744059-091c-46fe-8594-de8a687d02a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=37af776e1e594cf092bdcb7cf4e86379, role_id=4b7f458ff95746579a33e49826dabb89)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:36.918174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744059-091c-46fe-8594-de8a687d02a2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:36.933679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 531/1077] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:03:36 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/37af776e1e594cf092bdcb7cf4e86379/roles/4b7f458ff95746579a33e49826dabb89 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:03:37.377619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fb06f-2f18-4d96-8bc9-1977c81f8d8f None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:37.378181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fb06f-2f18-4d96-8bc9-1977c81f8d8f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:37.378181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fb06f-2f18-4d96-8bc9-1977c81f8d8f None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:37.379628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 547/1078] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:37.385381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:37.385661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:37.385935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:37.404323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:37.405668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:37.481411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 532/1079] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:37.504099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fb06f-2f18-4d96-8bc9-1977c81f8d8f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:37.611895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:37.616649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fb06f-2f18-4d96-8bc9-1977c81f8d8f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:37.665110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:37.665964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:37.666241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:37.666512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:37.677459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:37.685021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:37.686975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:37.688207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 548/1080] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:03:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:37.692966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:37.758925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:37.802992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377eff8-f0c9-4a7f-a26e-c982165e8416 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:37.839282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:37.839961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:37.840244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:37.840633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:37.841416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:37.841728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:37.843143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:37.851777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 533/1081] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:37.857725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:37.972468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae07788-24af-4204-8aaf-7b999bb7511c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:38.006864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:38.007737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:38.008014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:38.008285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] PATH_INFO: `/v3/users/31dfcf88e7d84699938e87aecd9a9477` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:38.009552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] RBAC: Authorizing `identity:get_user(user_id=31dfcf88e7d84699938e87aecd9a9477)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:38.010976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:38.012620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 549/1082] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:37 2022] GET /identity/v3/users/31dfcf88e7d84699938e87aecd9a9477 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:38.018804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:38.127864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34d45a-b1ea-477e-afe1-c974ee402cdb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:38.151188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:38.163740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd4a3a-a3fc-490a-b4da-e2907af0f95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:38.164613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd4a3a-a3fc-490a-b4da-e2907af0f95a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:38.164888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd4a3a-a3fc-490a-b4da-e2907af0f95a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:38.165156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd4a3a-a3fc-490a-b4da-e2907af0f95a None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:38.166388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd4a3a-a3fc-490a-b4da-e2907af0f95a None admin] RBAC: Authorizing `identity:get_project(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:38.167827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd4a3a-a3fc-490a-b4da-e2907af0f95a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:38.169554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 534/1083] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:03:38 2022] GET /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:38.175970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:38.210620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:38.304037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f96b7b-304c-4e7d-8db0-80843d1864e6 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:38.341802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a81e35-f027-4167-a786-8de05f4a1e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:38.342596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a81e35-f027-4167-a786-8de05f4a1e74 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:38.342883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a81e35-f027-4167-a786-8de05f4a1e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:38.343154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a81e35-f027-4167-a786-8de05f4a1e74 None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2/users/31dfcf88e7d84699938e87aecd9a9477/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:38.345316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a81e35-f027-4167-a786-8de05f4a1e74 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2, user_id=31dfcf88e7d84699938e87aecd9a9477, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:38.346820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a81e35-f027-4167-a786-8de05f4a1e74 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:38.360765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 550/1084] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:03:38 2022] PUT /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2/users/31dfcf88e7d84699938e87aecd9a9477/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:03:39.090147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773ef8e-eeab-4af1-b61b-f2c9f95b6e82 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:39.090690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773ef8e-eeab-4af1-b61b-f2c9f95b6e82 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:39.090803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773ef8e-eeab-4af1-b61b-f2c9f95b6e82 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:39.092465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 535/1085] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:39.098032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:39.098500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:39.098600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:39.116561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:39.117815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:39.189960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 551/1086] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:39.213727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773ef8e-eeab-4af1-b61b-f2c9f95b6e82 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:39.335464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773ef8e-eeab-4af1-b61b-f2c9f95b6e82 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:39.375207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:39.375925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:39.376203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:39.376478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:39.388081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:39.396553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:39.398694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:39.400678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 536/1087] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Jun 15 22:03:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:39.407425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:39.439029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:39.548267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3fa4b-62a8-476c-94e2-fe8af730279d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:39.584574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:39.585249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:39.585557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:39.585826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:39.586580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:39.586881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:39.588258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:39.602602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 552/1088] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:03:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:39.603937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:39.666954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:39.720073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba41f90-caa5-4280-bd52-f106773ff0e3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:39.755347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:39.756153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:39.756436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:39.756712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:39.771270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:39.772740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:39.791080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:39.792030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:39.793165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:39.793165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:39.793165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:39.793165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:39.793165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 537/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:39.798682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:39.891551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:39.914027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4252bf-8c53-448f-8fbd-4b340093870e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:39.956189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:39.956782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:39.957066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:39.957379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:39.958094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:39.958404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:39.959799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:39.973194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 553/1090] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:39.979338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.094345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da48fba-4eb1-4e39-8076-0e290becbe52 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:40.096833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:40.132704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:40.133551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.133835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.134104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.143301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:40.144751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:03:40.160115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:40.161738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 22:03:40.162742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:40.165493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 538/1091] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jun 15 22:03:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:40.167886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.286476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5e12d-013d-40ca-beab-3805ff1dc9ad None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:40.326239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:40.327317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.327608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.327887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.328760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:40.329057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:40.330575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcb0c2-bc39-47ed-920d-0cb250b55951 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:40.340257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:40.351030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 554/1092] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:40.357598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.473347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b976c9c-6457-4af7-911d-d77a178656f4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:40.510830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:40.511403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.511735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.512018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.513530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1186fa-1b62-4627-af93-0a8639d85b7c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.513820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1186fa-1b62-4627-af93-0a8639d85b7c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.514642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1186fa-1b62-4627-af93-0a8639d85b7c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.516358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 555/1093] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:03:40.521700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.521985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.522263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.540619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:40.541851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:40.547374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:40.585004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:40.586494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:40.610838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 556/1094] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:40.634062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.688737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 539/1095] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:40.694645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.733497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d520cfa-b179-4b2c-bd00-000a571d89fe None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:40.756473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:40.760341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:40.769462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:40.770307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.770589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.770864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.781299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:03:40.789180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:40.790366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:03:40.791635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 557/1096] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:03:40.796984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.798733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5978d7-8a45-4ec0-bb0b-5110ce707caa None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:40.839475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:40.840286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.840564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.840804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.851193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:40.852630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:03:40.870735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:40.872387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:40.873412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:03:40.873412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:03:40.873412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:03:40.873412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:40.873412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 540/1097] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:40.878100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.918588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca71b5-36d4-4f99-b3a7-d94eb7e93a29 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:40.954028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:40.954706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:40.954979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:40.955248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:40.955996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:40.956301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:40.957709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:40.966002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 558/1098] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:40.972042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:40.990140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24e252-4fc5-4e2f-b5aa-b0b6544ac240 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.007366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:41.024330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:41.026145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.026814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.027095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.027686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.028407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:41.028714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.030310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.041797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 541/1099] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:41.047934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:41.081656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97675e77-d7d8-4e4e-9c4d-9a869b6520fa None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.115938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.116834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.117128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.117424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] PATH_INFO: `/v3/users/31dfcf88e7d84699938e87aecd9a9477` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.118677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] RBAC: Authorizing `identity:get_user(user_id=31dfcf88e7d84699938e87aecd9a9477)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.120139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.121851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 559/1100] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:40 2022] GET /identity/v3/users/31dfcf88e7d84699938e87aecd9a9477 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:41.128097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:41.147258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3669-af59-4664-9cc7-31a443872ae3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.182442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.183255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.183552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.183862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.190971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.192432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:03:41.209203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:03:41.210551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:03:41.211912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 542/1101] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:03:41.222167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:41.239447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820274a-852f-437b-b2bf-f14eb8b44ddb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.257683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:41.262678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:41.292728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.293340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.293640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.293912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.337316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7959a5-77d6-462e-8960-2753ba7fd854 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.379396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e1149-634d-4179-b852-f146170d928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.379749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.380404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e1149-634d-4179-b852-f146170d928e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.380719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e1149-634d-4179-b852-f146170d928e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.381030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e1149-634d-4179-b852-f146170d928e None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.381238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.382384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e1149-634d-4179-b852-f146170d928e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:41.382887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e1149-634d-4179-b852-f146170d928e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.385273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e1149-634d-4179-b852-f146170d928e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.404481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 543/1102] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:41.410983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e1149-634d-4179-b852-f146170d928e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:41.494863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 560/1103] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:41.501874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:41.516908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:41.522276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:41.524784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e1149-634d-4179-b852-f146170d928e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.562510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.563103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.563383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.563662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.564504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] RBAC: Adding query filter params (role.id=4b7f458ff95746579a33e49826dabb89, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=37af776e1e594cf092bdcb7cf4e86379) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:41.564815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.566316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.572545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 544/1104] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:41 2022] GET /identity/v3/role_assignments?user.id=37af776e1e594cf092bdcb7cf4e86379&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=4b7f458ff95746579a33e49826dabb89 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:41.617858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561cc9f-4ab4-47c2-b26c-172a3f4d3f92 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.661058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de871925-1856-462c-b842-de8f8dd2e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.662289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de871925-1856-462c-b842-de8f8dd2e98a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.662565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de871925-1856-462c-b842-de8f8dd2e98a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.662869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de871925-1856-462c-b842-de8f8dd2e98a None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.664311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de871925-1856-462c-b842-de8f8dd2e98a None admin] RBAC: Authorizing `identity:get_project(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.665850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de871925-1856-462c-b842-de8f8dd2e98a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.667665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 561/1105] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:03:41 2022] GET /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:41.674531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:41.794256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa55358-9271-4ca2-b9ad-74b7b931242a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:41.830118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:41.830706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:41.830993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:41.831267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:41.832099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2, user.id=31dfcf88e7d84699938e87aecd9a9477) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:41.832409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:41.833888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f8404-4cb8-48a9-80dc-bdab060dd4f6 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:41.840333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 545/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:41 2022] GET /identity/v3/role_assignments?user.id=31dfcf88e7d84699938e87aecd9a9477&scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:44.052761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb1b9-8707-4bde-a719-1630d9b44f1f None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:44.053357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb1b9-8707-4bde-a719-1630d9b44f1f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:44.053357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcb1b9-8707-4bde-a719-1630d9b44f1f None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:44.054881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 562/1107] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:44.062722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:44.063231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:44.063231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:44.082223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:44.083463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:44.104360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:44.163634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 546/1108] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:44.192426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb1b9-8707-4bde-a719-1630d9b44f1f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:44.287938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:44.305268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcb1b9-8707-4bde-a719-1630d9b44f1f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:44.341441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ed11-94ee-4279-a0aa-202244e54053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:44.342615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ed11-94ee-4279-a0aa-202244e54053 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:44.342904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ed11-94ee-4279-a0aa-202244e54053 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:44.343182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ed11-94ee-4279-a0aa-202244e54053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:44.344442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00ed11-94ee-4279-a0aa-202244e54053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:44.345937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00ed11-94ee-4279-a0aa-202244e54053 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:44.347602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 563/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:44.353643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:44.462394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ca459-e5e3-4e2d-a90b-d592ed44f4d8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:44.501610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d29ca-1211-4a88-a3ed-9683c24bdbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:44.502265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d29ca-1211-4a88-a3ed-9683c24bdbbd None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:44.502545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d29ca-1211-4a88-a3ed-9683c24bdbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:44.502818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d29ca-1211-4a88-a3ed-9683c24bdbbd None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:44.503557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d29ca-1211-4a88-a3ed-9683c24bdbbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:44.505012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d29ca-1211-4a88-a3ed-9683c24bdbbd None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:44.528739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 547/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:03:44 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:03:46.753399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d82e3-75bb-41ea-8f84-1b08e9639bba None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:46.753974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d82e3-75bb-41ea-8f84-1b08e9639bba None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:46.753974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d82e3-75bb-41ea-8f84-1b08e9639bba None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:46.755339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 564/1111] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:46.766552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:46.767089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:46.767089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:46.784951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:46.786602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:46.789741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:46.866791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 548/1112] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:46.891711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d82e3-75bb-41ea-8f84-1b08e9639bba None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:46.999839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d82e3-75bb-41ea-8f84-1b08e9639bba None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:47.044831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:47.045880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:47.046137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:47.046416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] PATH_INFO: `/v3/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:47.047996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] RBAC: Authorizing `identity:get_role(role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:47.049421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:47.050821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 565/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:46 2022] GET /identity/v3/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:47.056950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:47.172325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d726ce-9730-44d1-85e0-987a5a921716 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:47.207570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:47.208451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:47.208736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:47.209010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] PATH_INFO: `/v3/users/86d37e0e63de4c57875d5a1b1ec049b7` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:47.219823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:47.223695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] RBAC: Authorizing `identity:get_user(user_id=86d37e0e63de4c57875d5a1b1ec049b7)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:47.225543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:47.227428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 549/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:47 2022] GET /identity/v3/users/86d37e0e63de4c57875d5a1b1ec049b7 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:47.233393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:47.259514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:47.355155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df95b-5c09-4c85-bc6d-c16dae6f00df None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:47.392213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:47.392890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:47.393175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:47.393492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:47.494226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:47.495712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:47.521177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:47.603748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 566/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:47.610165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:47.723534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e64abd-daca-4c20-bfc6-d8ccc6cb0400 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:47.763011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049575-49ae-43a9-a16f-3cacc66e4816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:47.764067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049575-49ae-43a9-a16f-3cacc66e4816 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:47.764639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049575-49ae-43a9-a16f-3cacc66e4816 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:47.764762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049575-49ae-43a9-a16f-3cacc66e4816 None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:47.765960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049575-49ae-43a9-a16f-3cacc66e4816 None admin] RBAC: Authorizing `identity:get_project(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:47.767403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049575-49ae-43a9-a16f-3cacc66e4816 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:47.769147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 550/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:03:47 2022] GET /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:47.775697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:47.881032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb029d-2760-4e56-a754-be945afa2ed1 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:47.904762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:47.917752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:47.918453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:47.918735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:47.919005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:47.919847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] RBAC: Adding query filter params (role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2, user.id=86d37e0e63de4c57875d5a1b1ec049b7) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:47.920195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:47.921731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7393b-8826-498f-9963-cc2a4dda6701 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:47.927911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 567/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:47 2022] GET /identity/v3/role_assignments?user.id=86d37e0e63de4c57875d5a1b1ec049b7&scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:50.112183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b7a6-df29-4eb1-a750-27198b053f59 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:50.112771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b7a6-df29-4eb1-a750-27198b053f59 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:50.112771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5b7a6-df29-4eb1-a750-27198b053f59 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:50.114125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 551/1118] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:50.120037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:50.120558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:50.120650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:50.138440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:50.139703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:50.213298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 568/1119] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:50.243362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5b7a6-df29-4eb1-a750-27198b053f59 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:50.323731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:50.369186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5b7a6-df29-4eb1-a750-27198b053f59 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:50.407833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:50.408703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:50.408977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:50.409246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] PATH_INFO: `/v3/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:50.411141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] RBAC: Authorizing `identity:get_role(role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:50.412516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:50.413948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 552/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:50 2022] GET /identity/v3/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:50.420542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:50.533353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c9c3-c4a3-4255-ba42-47b11ff7b622 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:50.554157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:50.575938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:50.577684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:50.578011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:50.578330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] PATH_INFO: `/v3/users/86d37e0e63de4c57875d5a1b1ec049b7` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:50.579742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] RBAC: Authorizing `identity:get_user(user_id=86d37e0e63de4c57875d5a1b1ec049b7)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:50.581388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:50.583164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 569/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:50 2022] GET /identity/v3/users/86d37e0e63de4c57875d5a1b1ec049b7 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:50.589911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:50.705894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ba1d3-607b-491a-b63e-ae11b7dd4552 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:50.743639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbdb5-7595-49b2-a5b3-3eb5e16e297e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:50.744504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbdb5-7595-49b2-a5b3-3eb5e16e297e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:50.744796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbdb5-7595-49b2-a5b3-3eb5e16e297e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:50.745065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbdb5-7595-49b2-a5b3-3eb5e16e297e None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:50.746330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbdb5-7595-49b2-a5b3-3eb5e16e297e None admin] RBAC: Authorizing `identity:get_project(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:50.747807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbdb5-7595-49b2-a5b3-3eb5e16e297e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:50.749657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 553/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:03:50 2022] GET /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:03:50.755968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:50.873124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381e1d1-d955-4a3c-9a8b-01c17546345a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:50.922272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8fd5b-2056-45b6-aef0-fb8c82b51337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:50.923196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8fd5b-2056-45b6-aef0-fb8c82b51337 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:50.923635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8fd5b-2056-45b6-aef0-fb8c82b51337 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:50.924097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8fd5b-2056-45b6-aef0-fb8c82b51337 None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2/users/86d37e0e63de4c57875d5a1b1ec049b7/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:50.927136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8fd5b-2056-45b6-aef0-fb8c82b51337 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2, user_id=86d37e0e63de4c57875d5a1b1ec049b7, role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:50.928644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8fd5b-2056-45b6-aef0-fb8c82b51337 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:50.943991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 570/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:03:50 2022] PUT /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2/users/86d37e0e63de4c57875d5a1b1ec049b7/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:03:53.129527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da188c58-e073-4862-a85d-ed12b6d6d27b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:53.130142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da188c58-e073-4862-a85d-ed12b6d6d27b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:53.130142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da188c58-e073-4862-a85d-ed12b6d6d27b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:53.131575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 554/1124] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:53.138047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:53.138696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:53.138696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:53.158563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:53.159967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:53.209209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:53.249714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 571/1125] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:53.274505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da188c58-e073-4862-a85d-ed12b6d6d27b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:53.277791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:53.393005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da188c58-e073-4862-a85d-ed12b6d6d27b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:53.429722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:53.430588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:53.430859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:53.431127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] PATH_INFO: `/v3/roles/f0b45d2cac394211a9e34ffe2c4a4b05` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:53.432629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] RBAC: Authorizing `identity:get_role(role_id=f0b45d2cac394211a9e34ffe2c4a4b05)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:53.434041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:53.435464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 555/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:53 2022] GET /identity/v3/roles/f0b45d2cac394211a9e34ffe2c4a4b05 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:53.442483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:53.613610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571367-7004-4dc0-914b-fe995fc5d89b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:53.676201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:53.677714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:53.678191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:53.678673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] PATH_INFO: `/v3/users/86d37e0e63de4c57875d5a1b1ec049b7` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:53.680812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] RBAC: Authorizing `identity:get_user(user_id=86d37e0e63de4c57875d5a1b1ec049b7)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:53.683577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:53.686866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 572/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:03:53 2022] GET /identity/v3/users/86d37e0e63de4c57875d5a1b1ec049b7 => generated 286 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:53.693068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:53.775966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:53.813685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cda4f2-ca2d-4597-bb05-fb6292897f5b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:53.852336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:53.853119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:53.853492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:53.853810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:53.930820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:53.932300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:54.019993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:54.057680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 556/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:03:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:03:54.064695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:54.116291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:54.179500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998ade7-ccf8-4650-a2c2-b94b871121a4 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:54.218549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1042a2-0a51-4ff1-8d2b-087975428c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:54.219403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1042a2-0a51-4ff1-8d2b-087975428c91 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:54.219727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1042a2-0a51-4ff1-8d2b-087975428c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:54.220048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1042a2-0a51-4ff1-8d2b-087975428c91 None admin] PATH_INFO: `/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:54.221396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1042a2-0a51-4ff1-8d2b-087975428c91 None admin] RBAC: Authorizing `identity:get_project(project_id=c1d4f34e59534fd7ad1f217ba2cb7ea2)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:54.223137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1042a2-0a51-4ff1-8d2b-087975428c91 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:54.225000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 573/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:03:54 2022] GET /identity/v3/projects/c1d4f34e59534fd7ad1f217ba2cb7ea2 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:54.235326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:54.350391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e6058-0667-49aa-8b58-d1bddfa66b3a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:54.389688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:54.390382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:54.390665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:54.390937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:54.391784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] RBAC: Adding query filter params (role.id=f0b45d2cac394211a9e34ffe2c4a4b05, scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2, user.id=86d37e0e63de4c57875d5a1b1ec049b7) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:03:54.392095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:54.393581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecff459-6544-4d9d-8e62-e617befdecb0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:54.400543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 557/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:03:54 2022] GET /identity/v3/role_assignments?user.id=86d37e0e63de4c57875d5a1b1ec049b7&scope.project.id=c1d4f34e59534fd7ad1f217ba2cb7ea2&role.id=f0b45d2cac394211a9e34ffe2c4a4b05 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:56.636951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d042cdd-e993-4684-97f5-eee9175311e8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:56.637532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d042cdd-e993-4684-97f5-eee9175311e8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:56.637532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d042cdd-e993-4684-97f5-eee9175311e8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:56.638870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 574/1131] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:56.644378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:56.644837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:56.644924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:56.663416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:56.664645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:56.694402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:56.738535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 558/1132] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:56.762698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d042cdd-e993-4684-97f5-eee9175311e8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:56.875035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d042cdd-e993-4684-97f5-eee9175311e8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:56.886342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:56.912670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8023-f6ae-4435-ab5d-792a83f7a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:56.913520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8023-f6ae-4435-ab5d-792a83f7a0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:56.913811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8023-f6ae-4435-ab5d-792a83f7a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:56.914115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8023-f6ae-4435-ab5d-792a83f7a0e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:56.915497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8023-f6ae-4435-ab5d-792a83f7a0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:56.917065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8023-f6ae-4435-ab5d-792a83f7a0e1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:56.918893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 575/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:56.925179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:57.037866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9a163-3c54-4619-936d-8eeebc023573 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:57.074550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f844fd-03d8-4d73-bce2-d281be650906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:57.075220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f844fd-03d8-4d73-bce2-d281be650906 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:57.075496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f844fd-03d8-4d73-bce2-d281be650906 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:57.075767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f844fd-03d8-4d73-bce2-d281be650906 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:57.077139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f844fd-03d8-4d73-bce2-d281be650906 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:57.078621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f844fd-03d8-4d73-bce2-d281be650906 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:57.106420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 559/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:03:56 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:03:59.330877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445564b-1c52-4463-a0ea-ff504f9deaa2 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:59.331520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445564b-1c52-4463-a0ea-ff504f9deaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:59.331520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445564b-1c52-4463-a0ea-ff504f9deaa2 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:59.332767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 576/1135] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:03:59.338696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:59.339182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:59.339289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:59.357879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:03:59.359335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:03:59.370998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:03:59.431948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 560/1136] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:03:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:03:59.457468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445564b-1c52-4463-a0ea-ff504f9deaa2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:59.562174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445564b-1c52-4463-a0ea-ff504f9deaa2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:59.597546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19aba0-8c2b-4220-b5e6-7499e5328a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:59.598365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19aba0-8c2b-4220-b5e6-7499e5328a12 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:59.598647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19aba0-8c2b-4220-b5e6-7499e5328a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:59.598922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19aba0-8c2b-4220-b5e6-7499e5328a12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:59.600144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19aba0-8c2b-4220-b5e6-7499e5328a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:59.601628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19aba0-8c2b-4220-b5e6-7499e5328a12 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:59.603265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 577/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:03:59.609455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:03:59.717743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652f877-e9c4-4a33-bf49-1dc6fc3cc89c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:03:59.753712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d54dc-7a68-4385-96f2-cccaadbca466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:03:59.754387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d54dc-7a68-4385-96f2-cccaadbca466 None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:03:59.754675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d54dc-7a68-4385-96f2-cccaadbca466 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:03:59.754944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d54dc-7a68-4385-96f2-cccaadbca466 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:03:59.755678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d54dc-7a68-4385-96f2-cccaadbca466 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:03:59.757124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d54dc-7a68-4385-96f2-cccaadbca466 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:03:59.779158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 561/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:03:59 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:04:01.986159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc636-4654-4f95-a87a-bff032344bd0 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:01.986775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc636-4654-4f95-a87a-bff032344bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:01.986775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdc636-4654-4f95-a87a-bff032344bd0 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:01.988074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 578/1139] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:01.994715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:01.995225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:01.995335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:02.001103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:02.015644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:02.016865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:02.090243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 562/1140] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:04:02.114380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdc636-4654-4f95-a87a-bff032344bd0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:02.180635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:02.241133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdc636-4654-4f95-a87a-bff032344bd0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:02.277295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:02.278298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:02.278448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:02.278675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:02.290163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:04:02.298004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:02.299169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:04:02.300073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 579/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:04:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:02.305814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:02.410520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37277a-9173-4e4e-85c1-9e6cc43cd128 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:02.444148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:02.450255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:02.450953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:02.451602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:02.451602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:02.452293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:02.452594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:02.453998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:02.463052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 563/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:04:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:02.474223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:02.578026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994a0a-f449-4d97-8f86-1d6afa869b55 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:02.585114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:02.613629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:02.614519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:02.614789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:02.615054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] PATH_INFO: `/v3/users/a6d3ef7a36be4bdeab7b8affcf8bad80` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:02.628702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] RBAC: Authorizing `identity:get_user(user_id=a6d3ef7a36be4bdeab7b8affcf8bad80)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:02.630187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:02.631889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 580/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:04:02 2022] GET /identity/v3/users/a6d3ef7a36be4bdeab7b8affcf8bad80 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:02.637914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:02.740489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1275ccc-7a14-45a1-97da-6b7ec7e1cc4f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:02.778147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:02.778793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:02.779104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:02.779421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:02.848345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:02.855944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:02.857459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:02.970211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 564/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:04:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:04:02.976438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:03.084714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12bf93-a898-4fd4-a1ca-c17d730229fb None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:03.121116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4a94c-1b39-49c2-80f9-43d7a8335f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:03.121933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a94c-1b39-49c2-80f9-43d7a8335f40 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:03.122212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a94c-1b39-49c2-80f9-43d7a8335f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:03.122483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4a94c-1b39-49c2-80f9-43d7a8335f40 None admin] PATH_INFO: `/v3/projects/689e89a4d0484b0fb44cfe580e590410` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:03.124099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a94c-1b39-49c2-80f9-43d7a8335f40 None admin] RBAC: Authorizing `identity:get_project(project_id=689e89a4d0484b0fb44cfe580e590410)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:03.125562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4a94c-1b39-49c2-80f9-43d7a8335f40 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:03.127305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 581/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:04:02 2022] GET /identity/v3/projects/689e89a4d0484b0fb44cfe580e590410 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:03.133908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:03.235420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:03.242883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26329ec-e5f0-43e5-bf49-2ae534c89f0e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:03.279957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:03.280624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:03.280908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:03.281186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:03.282056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=689e89a4d0484b0fb44cfe580e590410, user.id=a6d3ef7a36be4bdeab7b8affcf8bad80) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:03.282366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:03.283822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63ae81-5fee-47e4-96a3-a26c7c890009 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:03.290090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 565/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:04:03 2022] GET /identity/v3/role_assignments?user.id=a6d3ef7a36be4bdeab7b8affcf8bad80&scope.project.id=689e89a4d0484b0fb44cfe580e590410&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:05.450997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67e6d-bdd3-4823-b8cf-45edb9995cc5 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:05.451590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67e6d-bdd3-4823-b8cf-45edb9995cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:05.451590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67e6d-bdd3-4823-b8cf-45edb9995cc5 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:05.453006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 582/1147] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:05.459629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:05.460122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:05.460614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:05.490816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:05.492797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:05.593192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 566/1148] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:05.616609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67e6d-bdd3-4823-b8cf-45edb9995cc5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:05.650008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:05.726334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67e6d-bdd3-4823-b8cf-45edb9995cc5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:05.762083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:05.762796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:05.763077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:05.763353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:05.774245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:04:05.781941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:05.783080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:04:05.783962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 583/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:05.790243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:05.884466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:05.898631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b41f3-6407-4c6a-ab29-4a2b24007a5b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:05.938946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:05.939634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:05.939918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:05.940180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:05.940944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:05.941249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:05.942665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:05.951793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 567/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:05.957911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:06.057742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:06.068389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99303871-2262-4471-9220-5ecbda395c21 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:06.104925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:06.105841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:06.106120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:06.106367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] PATH_INFO: `/v3/users/a6d3ef7a36be4bdeab7b8affcf8bad80` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:06.107787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] RBAC: Authorizing `identity:get_user(user_id=a6d3ef7a36be4bdeab7b8affcf8bad80)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:06.109238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:06.110966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 584/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:04:05 2022] GET /identity/v3/users/a6d3ef7a36be4bdeab7b8affcf8bad80 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:06.117008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:06.231997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa9dc-bcea-47db-a27e-60b0e0c7e7c8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:06.268920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e375e61-bddc-4b0f-9ee2-83ec62b1a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:06.269845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e375e61-bddc-4b0f-9ee2-83ec62b1a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:06.270150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e375e61-bddc-4b0f-9ee2-83ec62b1a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:06.270429 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e375e61-bddc-4b0f-9ee2-83ec62b1a3b3 None admin] PATH_INFO: `/v3/projects/689e89a4d0484b0fb44cfe580e590410` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:06.271673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e375e61-bddc-4b0f-9ee2-83ec62b1a3b3 None admin] RBAC: Authorizing `identity:get_project(project_id=689e89a4d0484b0fb44cfe580e590410)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:06.273125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e375e61-bddc-4b0f-9ee2-83ec62b1a3b3 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:06.274896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 568/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:04:06 2022] GET /identity/v3/projects/689e89a4d0484b0fb44cfe580e590410 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:06.281548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:06.393888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc006af-72e7-4cdd-b1b1-96d5dfd74f9c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:06.434966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1daf3-ee38-4052-9920-120e01dbd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:06.436015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1daf3-ee38-4052-9920-120e01dbd5d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:06.436327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1daf3-ee38-4052-9920-120e01dbd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:06.436681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1daf3-ee38-4052-9920-120e01dbd5d5 None admin] PATH_INFO: `/v3/projects/689e89a4d0484b0fb44cfe580e590410/users/a6d3ef7a36be4bdeab7b8affcf8bad80/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:06.439010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1daf3-ee38-4052-9920-120e01dbd5d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=689e89a4d0484b0fb44cfe580e590410, user_id=a6d3ef7a36be4bdeab7b8affcf8bad80, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:06.440563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1daf3-ee38-4052-9920-120e01dbd5d5 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:06.459213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 585/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:04:06 2022] PUT /identity/v3/projects/689e89a4d0484b0fb44cfe580e590410/users/a6d3ef7a36be4bdeab7b8affcf8bad80/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:04:08.635316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2930e37-198f-40b8-8361-330a497474fb None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:08.635856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2930e37-198f-40b8-8361-330a497474fb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:08.635856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2930e37-198f-40b8-8361-330a497474fb None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:08.637270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 569/1154] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:08.643460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:08.643967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:08.644078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:08.662447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:08.663666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:08.679351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:08.738105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 586/1155] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:08.762081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2930e37-198f-40b8-8361-330a497474fb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:08.783303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:08.870937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2930e37-198f-40b8-8361-330a497474fb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:08.907485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:08.908295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:08.908573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:08.908958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:08.921526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:04:08.929912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:08.931056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:04:08.932141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 570/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:08.938121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:09.044123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce7d7-c76f-477a-b808-dbe22a563863 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:09.079987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:09.080667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:09.080956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:09.081218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:09.082006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:09.082311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:09.083687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:09.092333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 587/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:09.098614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:09.182374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:09.208281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b9be-2dba-42d7-b615-4b86f568bbd3 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:09.248499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:09.249446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:09.249695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:09.249965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] PATH_INFO: `/v3/users/a6d3ef7a36be4bdeab7b8affcf8bad80` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:09.251215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] RBAC: Authorizing `identity:get_user(user_id=a6d3ef7a36be4bdeab7b8affcf8bad80)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:09.252658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:09.254340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 571/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:04:09 2022] GET /identity/v3/users/a6d3ef7a36be4bdeab7b8affcf8bad80 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:09.260530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:09.278517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:09.368476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d768d6-2cae-48e1-acb9-b6bd9f141f65 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:09.405812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:09.406478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:09.406764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:09.407043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:09.479210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:09.480577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:09.495392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:09.589135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 588/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:04:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:04:09.595466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:09.701944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9999304-6cb0-4617-8b69-81f3c9d946f2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:09.742423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ebf14-01a8-4e1a-83e9-17d31f48d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:09.743227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ebf14-01a8-4e1a-83e9-17d31f48d342 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:09.743508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ebf14-01a8-4e1a-83e9-17d31f48d342 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:09.743783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ebf14-01a8-4e1a-83e9-17d31f48d342 None admin] PATH_INFO: `/v3/projects/689e89a4d0484b0fb44cfe580e590410` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:09.745269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ebf14-01a8-4e1a-83e9-17d31f48d342 None admin] RBAC: Authorizing `identity:get_project(project_id=689e89a4d0484b0fb44cfe580e590410)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:09.746887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ebf14-01a8-4e1a-83e9-17d31f48d342 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:09.748747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 572/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:04:09 2022] GET /identity/v3/projects/689e89a4d0484b0fb44cfe580e590410 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:09.755695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:09.868985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce1241-4b08-4b97-91e5-b65a8f9ad4fd None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:09.883853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:09.907789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:09.908485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:09.908771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:09.909048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:09.910319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=689e89a4d0484b0fb44cfe580e590410, user.id=a6d3ef7a36be4bdeab7b8affcf8bad80) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:09.910660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:09.912175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719857b2-b295-4e25-9925-49655ff57e7d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:09.919241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 589/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:04:09 2022] GET /identity/v3/role_assignments?user.id=a6d3ef7a36be4bdeab7b8affcf8bad80&scope.project.id=689e89a4d0484b0fb44cfe580e590410&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:12.098654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e613-b5fa-4411-a97c-8c6e08fcbe19 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:12.099253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e613-b5fa-4411-a97c-8c6e08fcbe19 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:12.099253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28e613-b5fa-4411-a97c-8c6e08fcbe19 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:12.100536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 573/1162] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:12.106308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:12.106762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:12.106869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:12.125947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:12.127149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:12.200111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 590/1163] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:12.223444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28e613-b5fa-4411-a97c-8c6e08fcbe19 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:12.241266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:12.332712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28e613-b5fa-4411-a97c-8c6e08fcbe19 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:12.369385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:12.369954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:12.370234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:12.370506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:12.442360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:12.443835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:12.459424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:12.548887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 574/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:04:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:04:12.555361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:12.665352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db231e-230d-45b8-9ea0-78f938e2f7c0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:12.673310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:12.704710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:12.705628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:12.705864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:12.706137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:12.714802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:12.716320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-badeff27-80b3-4642-b288-fad3328d593e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:12.733394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:12.734743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:04:12.735593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 591/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:04:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:12.741031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:12.850529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02caf87b-af77-4962-8453-ba8985e0be4a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:12.867683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:12.889738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:12.890421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:12.890674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:12.890977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:12.891693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:12.892004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:12.893401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ba6ce-6ee3-4024-bb36-d947c85641d2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:12.902150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 575/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Jun 15 22:04:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:15.141575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2a9c-b0af-4fff-8d71-37d10d50bbfb None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:15.142176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2a9c-b0af-4fff-8d71-37d10d50bbfb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:15.142176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2a9c-b0af-4fff-8d71-37d10d50bbfb None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:15.143474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 592/1167] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:15.149237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e344a-5c02-4ee9-b98f-5dd6b08ea0e8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:15.149759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e344a-5c02-4ee9-b98f-5dd6b08ea0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:15.149874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e344a-5c02-4ee9-b98f-5dd6b08ea0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:15.168780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fd7e344a-5c02-4ee9-b98f-5dd6b08ea0e8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:15.170088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fd7e344a-5c02-4ee9-b98f-5dd6b08ea0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:15.243570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 576/1168] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:04:15.266919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2a9c-b0af-4fff-8d71-37d10d50bbfb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:15.375623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2a9c-b0af-4fff-8d71-37d10d50bbfb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:15.411523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400f2e-cdfc-4919-99eb-79298403feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:15.412204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400f2e-cdfc-4919-99eb-79298403feef None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:15.412486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400f2e-cdfc-4919-99eb-79298403feef None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:15.412756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400f2e-cdfc-4919-99eb-79298403feef None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:15.413551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400f2e-cdfc-4919-99eb-79298403feef None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:15.414937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400f2e-cdfc-4919-99eb-79298403feef None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:15.431712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 593/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Wed Jun 15 22:04:15 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:04:17.629532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7921-0c58-49be-ba5c-830fbff3334a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:17.630079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7921-0c58-49be-ba5c-830fbff3334a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:17.630079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b7921-0c58-49be-ba5c-830fbff3334a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:17.631390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 577/1170] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:17.636993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:17.637446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:17.637575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:17.655827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:17.657049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:17.678824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:17.729338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 594/1171] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:17.753565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b7921-0c58-49be-ba5c-830fbff3334a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:17.868925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b7921-0c58-49be-ba5c-830fbff3334a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:17.879668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:17.906569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9af943-7f91-4012-857d-09fc5cd2f0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:17.907432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af943-7f91-4012-857d-09fc5cd2f0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:17.907708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af943-7f91-4012-857d-09fc5cd2f0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:17.907981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9af943-7f91-4012-857d-09fc5cd2f0c7 None admin] PATH_INFO: `/v3/domains/c89f1169c58c4c64854d4f29f0cb5413` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:17.919444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9af943-7f91-4012-857d-09fc5cd2f0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c89f1169c58c4c64854d4f29f0cb5413)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:17.921260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9af943-7f91-4012-857d-09fc5cd2f0c7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:17.922977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 578/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Jun 15 22:04:17 2022] GET /identity/v3/domains/c89f1169c58c4c64854d4f29f0cb5413 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:17.929079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:18.038638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513fecd-0a6e-46f9-9ce6-b08c7ec2e600 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:18.076505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b131bc-2f88-4e3b-8404-da8799632ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:18.077173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b131bc-2f88-4e3b-8404-da8799632ba4 None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:18.077488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b131bc-2f88-4e3b-8404-da8799632ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:18.077769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b131bc-2f88-4e3b-8404-da8799632ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:18.078482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b131bc-2f88-4e3b-8404-da8799632ba4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:18.079934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b131bc-2f88-4e3b-8404-da8799632ba4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:18.107689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 595/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:04:17 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:04:20.310216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdd3dd-aa66-4174-b732-509974a818d5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:20.311168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdd3dd-aa66-4174-b732-509974a818d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:20.311463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdd3dd-aa66-4174-b732-509974a818d5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:20.312851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 579/1174] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:20.318990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:20.319485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:20.319727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:20.338063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:20.339281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:20.341368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:20.414341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 596/1175] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:20.440466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdd3dd-aa66-4174-b732-509974a818d5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:20.554852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdd3dd-aa66-4174-b732-509974a818d5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:20.595129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a11ac-c0c6-43ab-b40b-5afa6ae787ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:20.596025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a11ac-c0c6-43ab-b40b-5afa6ae787ef None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:20.596309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a11ac-c0c6-43ab-b40b-5afa6ae787ef None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:20.596583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a11ac-c0c6-43ab-b40b-5afa6ae787ef None admin] PATH_INFO: `/v3/domains/c89f1169c58c4c64854d4f29f0cb5413` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:20.597973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a11ac-c0c6-43ab-b40b-5afa6ae787ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=c89f1169c58c4c64854d4f29f0cb5413)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:20.599466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a11ac-c0c6-43ab-b40b-5afa6ae787ef None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:20.601227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 580/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Jun 15 22:04:20 2022] GET /identity/v3/domains/c89f1169c58c4c64854d4f29f0cb5413 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:20.608081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:20.727540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaaa8a-ef03-424b-a4f8-9b8c3cb08843 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:20.770712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb03887-6545-474b-ae54-7cfc604554ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:20.771382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb03887-6545-474b-ae54-7cfc604554ac None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:20.771665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb03887-6545-474b-ae54-7cfc604554ac None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:20.771931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb03887-6545-474b-ae54-7cfc604554ac None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:20.772642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb03887-6545-474b-ae54-7cfc604554ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:20.774126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb03887-6545-474b-ae54-7cfc604554ac None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:20.783427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:20.801080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 597/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:04:20 2022] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:04:22.975753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5188df-570d-46a1-afb1-d353736a303c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:22.976302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5188df-570d-46a1-afb1-d353736a303c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:22.976302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5188df-570d-46a1-afb1-d353736a303c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:22.977703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 581/1178] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:22.983164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:22.983582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:22.983714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:23.001835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:23.003065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:23.080487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 598/1179] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:23.104573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5188df-570d-46a1-afb1-d353736a303c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:23.145387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:23.218991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5188df-570d-46a1-afb1-d353736a303c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:23.258762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:23.259035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:23.259313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:23.259582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:23.270821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:04:23.278344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:23.279417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:04:23.280268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 582/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:23.288355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:23.405930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c7faa-560d-4870-bfbc-7c88b1635dba None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:23.432852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:23.445922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:23.446607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:23.446904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:23.447170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:23.447934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:23.448244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:23.449668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:23.458333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 599/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:04:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:23.464547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:23.566579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:23.574025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4b4f-2cbf-42b4-8909-8765e096824a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:23.616469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:23.617366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:23.621531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:23.621816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] PATH_INFO: `/v3/users/ea1594f6831f42d1ba57d5903e3209c3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:23.640022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1594f6831f42d1ba57d5903e3209c3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:23.641880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:23.643693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 583/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:04:23 2022] GET /identity/v3/users/ea1594f6831f42d1ba57d5903e3209c3 => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:23.649771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:23.776151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce2c8e-ffae-4ae7-a419-6c90d8f8137a None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:23.812249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:23.813050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:23.813364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:23.813636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:23.872505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:23.886518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:23.887983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:24.004538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 600/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:04:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:04:24.010809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:24.115982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe852db-1c60-44b1-8d80-8f52f0a8f834 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:24.156513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e582fe-44b8-423f-b30d-cc0b5408b231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:24.157426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e582fe-44b8-423f-b30d-cc0b5408b231 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:24.157707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e582fe-44b8-423f-b30d-cc0b5408b231 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:24.157982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e582fe-44b8-423f-b30d-cc0b5408b231 None admin] PATH_INFO: `/v3/projects/16b455180158475599727c8f396e5fde` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:24.159241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e582fe-44b8-423f-b30d-cc0b5408b231 None admin] RBAC: Authorizing `identity:get_project(project_id=16b455180158475599727c8f396e5fde)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:24.161086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e582fe-44b8-423f-b30d-cc0b5408b231 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:24.162871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 584/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:04:24 2022] GET /identity/v3/projects/16b455180158475599727c8f396e5fde => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:24.169212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:24.257355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:24.273904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9575f-38f9-4e38-8216-b9e9e161fd26 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:24.310327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:24.311013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:24.311381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:24.311658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:24.312488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=16b455180158475599727c8f396e5fde, user.id=ea1594f6831f42d1ba57d5903e3209c3) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:24.312797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:24.314272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c830902-0e93-40a0-a1af-891ab205e923 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:24.320107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 601/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:04:24 2022] GET /identity/v3/role_assignments?user.id=ea1594f6831f42d1ba57d5903e3209c3&scope.project.id=16b455180158475599727c8f396e5fde&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:26.459493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f906-2464-459c-8040-7de3c7fafd70 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:26.460087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f906-2464-459c-8040-7de3c7fafd70 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:26.460087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949f906-2464-459c-8040-7de3c7fafd70 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:26.461421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 585/1186] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:26.467316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:26.467885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:26.467885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:26.485907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:26.487040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:26.559884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 602/1187] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:04:26.584023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f906-2464-459c-8040-7de3c7fafd70 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:26.611943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:26.708045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949f906-2464-459c-8040-7de3c7fafd70 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:26.744210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:26.744929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:26.745207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:26.745507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:26.757138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:04:26.764990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:26.766977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:04:26.769228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 586/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:04:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:26.773652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:26.863993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:26.886286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b956ead-b709-4030-a751-567b6ae7dbf5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:26.926103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:26.926802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:26.927084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:26.927357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:26.928134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:26.928445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:26.929897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:26.939522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 603/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:26.945656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:27.041146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:27.061493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cfe71-64a1-4a0f-9b82-d7f4b3995cfc None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:27.097665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:27.098572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:27.098848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:27.099121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] PATH_INFO: `/v3/users/ea1594f6831f42d1ba57d5903e3209c3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:27.100402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1594f6831f42d1ba57d5903e3209c3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:27.102117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:27.103907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 587/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:04:26 2022] GET /identity/v3/users/ea1594f6831f42d1ba57d5903e3209c3 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:27.110697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:27.220470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec4f0b-5ec0-43c7-a5f8-cc8367c70d09 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:27.263628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c1684-604d-4236-9f27-61d85f419d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:27.264426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1684-604d-4236-9f27-61d85f419d80 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:27.264802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1684-604d-4236-9f27-61d85f419d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:27.265086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c1684-604d-4236-9f27-61d85f419d80 None admin] PATH_INFO: `/v3/projects/16b455180158475599727c8f396e5fde` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:27.266364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1684-604d-4236-9f27-61d85f419d80 None admin] RBAC: Authorizing `identity:get_project(project_id=16b455180158475599727c8f396e5fde)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:27.267827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c1684-604d-4236-9f27-61d85f419d80 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:27.269647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 604/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:04:27 2022] GET /identity/v3/projects/16b455180158475599727c8f396e5fde => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:04:27.275789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:27.388219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0ff7-4f0a-4c56-9775-92e94cd89010 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:27.424983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7d2f9-3dd6-4f77-982b-126eb439e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:27.425923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7d2f9-3dd6-4f77-982b-126eb439e13b None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:27.426204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7d2f9-3dd6-4f77-982b-126eb439e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:27.426476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7d2f9-3dd6-4f77-982b-126eb439e13b None admin] PATH_INFO: `/v3/projects/16b455180158475599727c8f396e5fde/users/ea1594f6831f42d1ba57d5903e3209c3/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:27.428516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7d2f9-3dd6-4f77-982b-126eb439e13b None admin] RBAC: Authorizing `identity:create_grant(project_id=16b455180158475599727c8f396e5fde, user_id=ea1594f6831f42d1ba57d5903e3209c3, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:27.430022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7d2f9-3dd6-4f77-982b-126eb439e13b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:27.446272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 588/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:04:27 2022] PUT /identity/v3/projects/16b455180158475599727c8f396e5fde/users/ea1594f6831f42d1ba57d5903e3209c3/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:04:29.618828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f705e92-b685-498f-8a2e-b892820b390c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:29.619413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f705e92-b685-498f-8a2e-b892820b390c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:29.619413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f705e92-b685-498f-8a2e-b892820b390c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:29.620667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 605/1193] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:04:29.626223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:29.626680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:29.626781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:29.644811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:04:29.646048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:04:29.649065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:29.740064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 589/1194] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:04:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:04:29.764215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f705e92-b685-498f-8a2e-b892820b390c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:29.777860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:29.874603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f705e92-b685-498f-8a2e-b892820b390c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:29.910377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:29.911178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:29.911458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:29.911733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:29.924269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:04:29.931784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:04:29.932946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:04:29.934015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 606/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:04:29.940151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:30.066329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e709bd-26c5-4d1e-a712-af31c70285e8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:30.107256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:30.108092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:30.108399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:30.108676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:30.109456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:30.109801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:30.111188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:30.120136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 590/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:30.126900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:30.202638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:30.239282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3443a-c1ee-46c5-afdf-a7c18fd15bbd None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:30.275580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:30.276462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:30.276744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:30.277019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] PATH_INFO: `/v3/users/ea1594f6831f42d1ba57d5903e3209c3` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:30.278329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=ea1594f6831f42d1ba57d5903e3209c3)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:30.279807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:30.281496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 607/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jun 15 22:04:30 2022] GET /identity/v3/users/ea1594f6831f42d1ba57d5903e3209c3 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:30.287902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:30.291003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:30.400924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fb75b-64ea-4a49-9c15-bff8703d83d2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:30.439936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:30.440597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:30.440855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:30.441159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:30.515254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:30.516718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:30.518679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:30.622347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 591/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:04:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:04:30.628705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:30.738025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439f4e0-c354-47b7-8442-3c664f795cd4 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:30.775152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4b8fa-4945-4461-bbc7-c2653a4713e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:30.776027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4b8fa-4945-4461-bbc7-c2653a4713e0 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:30.776309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4b8fa-4945-4461-bbc7-c2653a4713e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:30.776580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4b8fa-4945-4461-bbc7-c2653a4713e0 None admin] PATH_INFO: `/v3/projects/16b455180158475599727c8f396e5fde` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:30.777910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4b8fa-4945-4461-bbc7-c2653a4713e0 None admin] RBAC: Authorizing `identity:get_project(project_id=16b455180158475599727c8f396e5fde)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:30.779401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4b8fa-4945-4461-bbc7-c2653a4713e0 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:30.781144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 608/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jun 15 22:04:30 2022] GET /identity/v3/projects/16b455180158475599727c8f396e5fde => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:30.788067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:04:30.906500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b208-b6bd-4584-82f2-e486b90c1398 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:04:30.908301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:30.946926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:04:30.947596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:04:30.947858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:04:30.948126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:04:30.948979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=16b455180158475599727c8f396e5fde, user.id=ea1594f6831f42d1ba57d5903e3209c3) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:04:30.949291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:04:30.950796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b56be-3182-49af-8082-432b5dc1ee65 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:04:30.959725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 592/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:04:30 2022] GET /identity/v3/role_assignments?user.id=ea1594f6831f42d1ba57d5903e3209c3&scope.project.id=16b455180158475599727c8f396e5fde&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:04:40.770694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:04:40.956197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=17 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:30.888352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ab092-7e4c-44a2-807b-451e5fd66f89 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:30.888352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ab092-7e4c-44a2-807b-451e5fd66f89 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:30.888352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ab092-7e4c-44a2-807b-451e5fd66f89 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:30.888352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 609/1201] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:30.895248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:30.896064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:30.896515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:30.921089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:30.922456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:31.042194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 593/1202] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:31.070843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ab092-7e4c-44a2-807b-451e5fd66f89 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:31.271597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ab092-7e4c-44a2-807b-451e5fd66f89 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:31.343131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:31.344320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:31.344613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:31.344890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:31.358259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:31.359997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:31.382428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:31.384256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:31.386094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:31.386094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:31.386094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:31.386094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:31.388440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 610/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:31.391458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:31.587043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd94cc-4d63-4846-87c4-694c5aa20530 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:31.636293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:31.650582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:31.651650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:31.652076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:31.652746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:31.653961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:31.654521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:31.656917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acdc7d-6097-407c-8499-960cc20aede5 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:31.680795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 594/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:05:31.690100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:31.789907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:31.882314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad0a38-1c47-47eb-8356-df8f4ffa2227 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:31.944823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af39221-4448-471f-926c-d54676d7c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:31.946133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39221-4448-471f-926c-d54676d7c03c None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:31.946824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39221-4448-471f-926c-d54676d7c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:31.947484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af39221-4448-471f-926c-d54676d7c03c None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:31.949098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af39221-4448-471f-926c-d54676d7c03c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:31.951816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af39221-4448-471f-926c-d54676d7c03c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:31.987334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 611/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jun 15 22:05:31 2022] POST /identity/v3/users => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:05:34.544383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41f96-f036-4f49-a5e1-b9a93b121f7d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:34.544942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41f96-f036-4f49-a5e1-b9a93b121f7d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:34.545029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e41f96-f036-4f49-a5e1-b9a93b121f7d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:34.547317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 595/1206] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:34.554725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:34.555278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:34.555478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:34.577561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:34.578869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:34.658380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 612/1207] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:34.683276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41f96-f036-4f49-a5e1-b9a93b121f7d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:34.819030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e41f96-f036-4f49-a5e1-b9a93b121f7d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:34.864517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:34.865882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:34.866362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:34.866961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:34.879702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:05:34.889296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:34.890350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:34.891240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 596/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:05:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:05:34.899484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:34.955339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:35.038354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787d402-19bb-4adb-9336-b895ca5bd549 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:35.083050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:35.083692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:35.084030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:35.084314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:35.085273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:35.085692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:35.087217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:35.101364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 613/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:05:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:35.104789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:35.168098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:35.231459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d68e1a-2c8e-4c51-af67-701cfbcbc8da None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:35.272114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:35.272948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:35.273227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:35.273652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:35.290056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:35.291844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:35.315743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:35.316978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:35.323016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:35.323016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:35.323016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:35.323016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:35.323016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 597/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:35.323363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:35.452457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:35.456455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca6d8a-f4fc-4f5e-a3bb-3ecff6ab3c64 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:35.499186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:35.499968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:35.500174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:35.500449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:35.501342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:35.501687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:35.503135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:35.518393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 614/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:35.524595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:35.665039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3e39a-1f09-45b0-b38f-a5b960e982c0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:35.666862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:35.724762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:35.724762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:35.725053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:35.725294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:35.736436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:35.738362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:05:35.760946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:35.762426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:35.763752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 598/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:35.769979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:35.902741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bde1c-5d16-4cae-bffe-16c66d1a2d8b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:35.974544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:35.975873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:35.975873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:35.975873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:35.977481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:35.978604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:35.981116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:36.003452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 615/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 15 22:05:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:36.009961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:36.162694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc80130-432b-4185-9193-9c8391b3d01d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:36.219481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:36.220151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:36.220439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:36.220734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:36.264384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:36.319309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:36.321050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:36.479942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 599/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:05:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:05:36.487154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:36.509335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:36.627721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c1e92-858c-4571-940b-85072ecb507b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:36.678643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:36.679136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:36.679405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:36.679640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:36.692826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:36.694635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:36.716712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:36.717834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:36.718752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:36.718752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:36.718752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:36.718752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:36.720826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 616/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:36.726950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:36.809843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:36.860774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15134781-23df-4a78-99ca-0526b6c3a7c9 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:36.897559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf43694-010e-451e-8211-e02162409072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:36.898247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43694-010e-451e-8211-e02162409072 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:36.898527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43694-010e-451e-8211-e02162409072 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:36.898797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf43694-010e-451e-8211-e02162409072 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:36.899520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43694-010e-451e-8211-e02162409072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:36.899824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43694-010e-451e-8211-e02162409072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:36.901208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf43694-010e-451e-8211-e02162409072 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:36.914307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 600/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:36.920172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:37.005025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:37.053624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512cee8-9fd0-4104-8ed8-12523b52e934 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:37.092918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:37.093592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:37.093952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:37.094203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:37.102546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:37.104015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:05:37.120117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:37.121200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:37.122647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 617/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:37.130682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf43694-010e-451e-8211-e02162409072 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:37.286742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf43694-010e-451e-8211-e02162409072 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:37.321478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:37.341504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:37.342269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:37.342551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:37.342832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:37.343696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:37.343989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:37.345467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666cf32-1634-41f7-9938-09c3a3075b30 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:37.363655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 601/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:37.370598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:37.496351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03589671-0b42-44a9-95c6-c6c9dc5b6234 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:37.539599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:37.547118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:37.549095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:37.549690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:37.550294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:37.551343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f07fe125a6a7414b9f2702cb75bf681e) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:37.551684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:37.553344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bd3a4-afbf-4aac-864c-5fc89172a9c1 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:37.560031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 618/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:05:37 2022] GET /identity/v3/role_assignments?user.id=f07fe125a6a7414b9f2702cb75bf681e&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:39.855006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700cba7-f279-4e17-bf12-507f7c393cca None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:39.855888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700cba7-f279-4e17-bf12-507f7c393cca None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:39.855888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700cba7-f279-4e17-bf12-507f7c393cca None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:39.857840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 602/1220] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:39.863614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:39.864116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:39.864202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:39.882198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:39.883525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:39.963344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 619/1221] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:39.988938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700cba7-f279-4e17-bf12-507f7c393cca None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:40.110750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700cba7-f279-4e17-bf12-507f7c393cca None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:40.145828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:40.146960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:40.147277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:40.147575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:40.161808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:05:40.170750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:40.172059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:40.174614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 603/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:40.178831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:40.291379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6b01b-3c83-46c3-800e-fa340d7fc0f1 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:40.317675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:40.329953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:40.330769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:40.331147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:40.331453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:40.332380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] RBAC: Adding query filter params (name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:40.332723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:40.334300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:40.344155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 620/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:05:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:40.350395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:40.398393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:40.466014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412f879-83b6-4bf7-b3bc-315c3593259d None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:40.513808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:40.514636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:40.514938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:40.515247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:40.527795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:40.529305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:40.551531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:40.552675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:40.558635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:40.558635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:40.558635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:40.558635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:40.558635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 604/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:05:40.559935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:40.679845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db14f8-30f2-4464-82c6-f35faa0ed959 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:40.713996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:40.714686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:40.715067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:40.715351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:40.716086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:40.716393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:40.717821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:40.730263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 621/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:05:40.736697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:40.848724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:40.860295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64d934-c8f5-4a2e-9ccf-de490e8c75c0 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:40.905225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:40.906087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:40.906371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:40.906645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:40.915628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:40.917196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:05:40.935476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:40.936695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:40.937874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 605/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:40.943058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:41.001073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:41.060398 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7aeb9-b927-4c74-8600-2dc64a3a5c2e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:41.099841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:41.100607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:41.100904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:41.101222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:41.102210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:41.102594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:41.104144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:41.124909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 622/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 15 22:05:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:05:41.130935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:41.247370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439071aa-2238-4727-a218-6ed855b569f7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:41.288694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:41.289672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:41.290100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:41.290359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:41.304526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:41.306053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:41.325138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:41.326346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:41.327263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:41.327263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:41.327263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:41.327263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:41.327263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 606/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:41.332942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:41.449075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62829e16-48ea-4ed2-97f0-81aff52a7c88 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:41.452175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:41.491799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:41.492436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:41.492684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:41.495493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:41.495493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:41.495493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:41.495493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:41.508770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 623/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:41.515787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:41.527062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:41.655123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e414c-4c62-4b3d-9aab-cd9f8e919b9e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:41.702135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:41.703120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:41.703438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:41.703755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:41.712012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:41.713561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:05:41.728921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:41.730043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:41.731628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:41.733567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 607/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:41.736672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:41.853873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3cc57-3854-4095-b24e-42a0139f2547 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:41.900073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:41.900761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:41.901046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:41.901346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:41.902143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:41.902479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:41.903936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a012c-19e1-460c-a73d-6fd6e7bc13c2 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:41.919819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 624/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:41.927118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:42.021974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:42.068162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c55dd-97bf-4380-8502-8c61b7a827cf None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:42.114128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d172c-b182-4674-b00f-1b571b246685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:42.115228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d172c-b182-4674-b00f-1b571b246685 None admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:42.115570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d172c-b182-4674-b00f-1b571b246685 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:42.116002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d172c-b182-4674-b00f-1b571b246685 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f07fe125a6a7414b9f2702cb75bf681e/roles/95cd9efde6ba4ba5b20e9a27de0dce07` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:42.137312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d172c-b182-4674-b00f-1b571b246685 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=f07fe125a6a7414b9f2702cb75bf681e, role_id=95cd9efde6ba4ba5b20e9a27de0dce07)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:42.139290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d172c-b182-4674-b00f-1b571b246685 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:42.155921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 608/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:05:41 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f07fe125a6a7414b9f2702cb75bf681e/roles/95cd9efde6ba4ba5b20e9a27de0dce07 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:05:44.463382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfdde-8a0a-4b14-be49-f0f1fe3969d1 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:44.463948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfdde-8a0a-4b14-be49-f0f1fe3969d1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:44.463948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfdde-8a0a-4b14-be49-f0f1fe3969d1 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:44.466017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 625/1233] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:44.471596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:44.472236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:44.472236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:44.490133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:44.491241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:44.573184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 609/1234] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:44.599101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfdde-8a0a-4b14-be49-f0f1fe3969d1 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:44.635126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:44.741944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfdde-8a0a-4b14-be49-f0f1fe3969d1 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:44.789342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:44.790949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:44.791237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:44.791516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:44.807714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:05:44.816847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:44.818125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 22:05:44.818987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:44.823210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 626/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jun 15 22:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:44.824386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:44.879161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:44.939607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a3419-42d8-4838-9ab0-054845f59577 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:44.978903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:44.979653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:44.979993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:44.980311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:44.981172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:44.981549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:44.983030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:44.992845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 610/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jun 15 22:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:05:44.999389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:45.095372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:45.113457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a24052-33fc-4d5c-8bf8-32ef4c0c6a25 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:45.150516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:45.151330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:45.151610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:45.151884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:45.164001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:45.165527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:45.184465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:45.185685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:45.186782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:45.186782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:45.186782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:45.186782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:45.192139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 627/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:45.193189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:45.313777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f7df3-a335-4a06-a7b8-b2568fd09c0c None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:45.323273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:45.355656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:45.356474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:45.356597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:45.356863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:45.357607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:45.358049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:45.359537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:45.374651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 611/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:05:45.380476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:45.497503 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383214-d80a-4bee-a1af-26c353dae092 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:45.535918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:45.536745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:45.537020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:45.537290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:45.540659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:45.547580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:45.549215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:05:45.566701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:45.567938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:45.569081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 628/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:05:45.574209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:45.699031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe6dd1-2d4b-4356-9b91-8ea9d4989687 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:45.742255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:45.742941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:45.743216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:45.743483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:45.744315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:45.744620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:45.746212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:45.766168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 612/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 15 22:05:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:05:45.772032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:45.901508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e976-326b-4981-9859-42ca8c3ce3ce None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:45.943535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:45.944262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:45.944527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:45.944802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:46.031528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:46.039374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:46.040933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:46.171878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 629/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:05:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:05:46.178125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:46.211085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:46.298349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50acc205-0edc-4d4e-85bb-1d971d4d865b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:46.338679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:46.339501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:46.340117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:46.340407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:46.353541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:46.355132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:46.376799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:46.377993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:46.379103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:46.379103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:46.379103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:46.379103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:46.379103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 613/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:46.384271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:46.490160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:46.496777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241baf7-5381-4eed-8a96-9846ea56765e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:46.535656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:46.536468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:46.536621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:46.536896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:46.537680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:46.537989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:46.539384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:46.552379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 630/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:46.558585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:46.645996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:46.670566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7debfe4-3e4c-4d3b-92e5-3e3f5ca68a4a None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:46.709812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:46.710793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:46.711170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:46.711538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:46.720004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:46.721892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:05:46.737640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:46.738715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:46.739738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 614/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 22:05:46.745294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:46.861838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c748-a7a2-4efa-bd8f-cf42d52d3a5f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:46.899987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:46.900672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:46.901002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:46.901236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:46.902049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:46.902359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:46.903827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c087c-9853-4689-8cb3-e0000b061ae8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:46.918064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 631/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:46.924439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:47.047369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ff60c-6963-4b1d-9d52-ca6851c8832e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:47.091871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:47.092654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:47.092951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:47.093227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:47.094146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] RBAC: Adding query filter params (role.id=95cd9efde6ba4ba5b20e9a27de0dce07, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f07fe125a6a7414b9f2702cb75bf681e) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:47.094458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:47.095890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010d971-3426-40b6-be88-1696dfd0645e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:47.102622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 615/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:05:46 2022] GET /identity/v3/role_assignments?user.id=f07fe125a6a7414b9f2702cb75bf681e&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=95cd9efde6ba4ba5b20e9a27de0dce07 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:49.438847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06d230-73b4-4ea9-93a1-8ee055f5f778 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:49.439458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06d230-73b4-4ea9-93a1-8ee055f5f778 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:49.439458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06d230-73b4-4ea9-93a1-8ee055f5f778 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:49.440780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 632/1247] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:49.448112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:49.448706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:49.448706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:49.454579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:49.470454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:49.472480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:49.560337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 616/1248] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:49.584157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06d230-73b4-4ea9-93a1-8ee055f5f778 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:49.604848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:49.716793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06d230-73b4-4ea9-93a1-8ee055f5f778 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:49.754439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:49.755310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:49.755593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:49.755867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:49.767848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:05:49.776078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:49.777308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:49.778566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 633/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:49.784861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:49.898334 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f8d53-3329-4c19-a897-68398299fd85 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:49.933250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:49.939843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:49.940846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:49.941259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:49.941760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:49.942186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:49.942487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:49.943877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:49.953858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 617/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:49.961069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:50.107783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:50.138297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5abfd-7951-47bc-9495-dd610832f92e None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:50.187238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:50.188127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:50.188408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:50.188832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:50.202726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:50.204665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:50.225148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:50.227389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:50.229550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:50.229550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:50.229550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:50.229550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:50.229550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 634/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:50.233788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:50.386998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b24add-648b-48dd-9679-1d194de55dfb None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:50.426303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:50.426995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:50.427277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:50.427557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:50.428301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:50.428603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:50.430026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:50.448402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 618/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:50.454658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:50.584692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb698c-bec7-4b88-8cf3-6e36b75c404b None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:50.618054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:50.627535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:50.628388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:50.628694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:50.629001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:50.638225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:50.639722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:05:50.654689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:50.655931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:50.656915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 635/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:50.662715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:50.730447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:50.794657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2485c7e-b440-49c4-84b8-419b9cd15807 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:50.834504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:50.835195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:50.835476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:50.835754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:50.836617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:50.836924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:50.838418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:50.860090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 619/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 15 22:05:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:50.866641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:50.994982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4fca5-f9ed-43a8-a620-d19620b0f6ca None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:51.037414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:51.038083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:51.038358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:51.038627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:51.104568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:51.123107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:51.124737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:51.257631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 636/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:05:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 22:05:51.264827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:51.384597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a9121-9939-457b-b538-a2e94ce22356 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:51.400861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:51.424871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:51.425710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:51.425993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:51.426269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:51.436976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:51.438527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:51.458407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:51.460165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:51.461366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:51.461366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:51.461366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:51.461366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:51.463104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 620/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:51.469352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:51.577242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:51.593316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c6a90-c62c-4187-aaee-bf679688956f None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:51.630585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:51.631438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:51.631816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:51.632170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:51.632892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:51.633200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:51.634630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:51.652895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 637/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:51.654237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:51.767645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f502c9-e9a9-4945-88bf-b6df59d4abf8 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:51.810648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:51.811460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:51.811763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:51.812015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:51.819327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:51.820953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:05:51.836938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:51.838098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:51.844385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 621/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:51.844996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:51.971142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdc7ef-0dec-4d53-ad74-d83193a78a84 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:52.017078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:52.017818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:52.018105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:52.018385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:52.019191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:52.019505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:52.020971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e3599-1e93-442c-87c1-32b9e07edbd3 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:52.045372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 638/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:52.048932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:52.085847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:52.175033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53cc37-3536-40fa-8475-5936a5be72ab None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:52.212301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:52.212983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:52.213261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:52.213571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:52.214415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f07fe125a6a7414b9f2702cb75bf681e) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:52.215080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:52.216642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266bc6-f178-4bfc-8068-98bf56b91dff None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:52.227183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 622/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:05:52 2022] GET /identity/v3/role_assignments?user.id=f07fe125a6a7414b9f2702cb75bf681e&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:54.371305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a54be-748a-4ec2-b959-95561f47c79b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:54.371901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a54be-748a-4ec2-b959-95561f47c79b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:54.371901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a54be-748a-4ec2-b959-95561f47c79b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:54.373274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 639/1261] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:54.378820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:54.379263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:54.379373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:54.396716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:54.397947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:54.468625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 623/1262] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:54.498380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a54be-748a-4ec2-b959-95561f47c79b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:54.510756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:54.612137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a54be-748a-4ec2-b959-95561f47c79b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:54.653336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:54.654149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:54.654434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:54.654714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:54.665833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:05:54.673366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:54.674433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:54.675620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 640/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:54.681023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:54.700492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:54.792087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9848e-c439-4b60-b6ae-0c9f38da276d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:54.827886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:54.828560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:54.828847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:54.829120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:54.829909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:54.830214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:54.831595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:54.840327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 624/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:54.846318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:54.918709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:54.962496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83be65-84e0-486d-a54a-bd0b93e0c38c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:55.010744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:55.011812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:55.012532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:55.012532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:55.023795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:55.025265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:55.043384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:55.044402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:55.045527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:55.045527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:55.045527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:55.045527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:55.045527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 641/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:55.052027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:55.145726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:55.172942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acde186-1475-406d-a8b5-16caf8fad5d4 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:55.212124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:55.212781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:55.213060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:55.213364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:55.214086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:55.214392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:55.216445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:55.229161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 625/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:55.235780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:55.340492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847069e-4900-4961-89a8-855d58edac9d None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:55.360928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:55.376516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:55.377357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:55.377646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:55.377918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:55.385962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:55.387460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:05:55.401915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:55.403304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:55.404327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 642/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:55.409674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:55.514077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0c5bb-4d2a-469c-8103-f154e88dcf73 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:55.549869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:55.550551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:55.550851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:55.551121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:55.551975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:55.552254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:55.553776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:55.563809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:55.574289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 626/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 15 22:05:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:55.580492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:55.684202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a4be-b916-4593-9eee-ae0f5a7ae389 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:55.719194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:55.720001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:55.720280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:55.720553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:55.731472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:55.732960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:55.750188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:55.751228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:55.752180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:55.752180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:55.752180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:55.752180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:55.752180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 643/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:55.757230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:55.860468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a29401-7f34-4dbe-bfc4-63bc67e4f848 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:55.895286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:55.895956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:55.896237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:55.896511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:55.897233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:55.897567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:55.898942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:55.910668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 627/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:55.916645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:55.954364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:56.035627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff96d2-359b-40a4-aabd-2ffe1ef15119 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:56.071814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:56.072631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:56.072914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:56.073190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:56.080561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:56.082071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:05:56.097467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:56.098532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:05:56.099695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 644/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:56.104898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:56.169883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:56.218256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfbb2b-eebe-4082-99d1-65359ab3d22f None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:56.255486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:56.256161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:56.256438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:56.256715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:56.257537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:56.257846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:56.259286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f689e-c0dd-4dd1-9c96-cda1554b6007 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:56.272093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 628/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:56.278705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:56.379517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:56.389412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a02c6-f69f-4af4-8c55-2549c79bf72c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:56.425902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d371e-2dd4-4455-80f3-8310d55ce733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:56.426802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d371e-2dd4-4455-80f3-8310d55ce733 None admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:56.427082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d371e-2dd4-4455-80f3-8310d55ce733 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:56.427355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d371e-2dd4-4455-80f3-8310d55ce733 None admin] PATH_INFO: `/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f07fe125a6a7414b9f2702cb75bf681e/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:56.429649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d371e-2dd4-4455-80f3-8310d55ce733 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb3dc60f951d4948b213ce7d5915c292, user_id=f07fe125a6a7414b9f2702cb75bf681e, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:56.431099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d371e-2dd4-4455-80f3-8310d55ce733 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:56.447245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 645/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jun 15 22:05:56 2022] PUT /identity/v3/projects/eb3dc60f951d4948b213ce7d5915c292/users/f07fe125a6a7414b9f2702cb75bf681e/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:05:58.544590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346bda-8d1f-439e-a388-9eda205d9cd7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:58.545147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346bda-8d1f-439e-a388-9eda205d9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:58.545147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8346bda-8d1f-439e-a388-9eda205d9cd7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:58.546464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 629/1274] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:05:58.551932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:58.552380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:58.552496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:58.570972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:05:58.572191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:05:58.648776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 646/1275] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:05:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:05:58.672159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8346bda-8d1f-439e-a388-9eda205d9cd7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:58.781092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8346bda-8d1f-439e-a388-9eda205d9cd7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:58.799954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:58.818266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:58.819065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:58.819343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:58.819585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:58.830526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 22:05:58.838094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:58.839134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:58.840329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 630/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jun 15 22:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:58.845627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:58.936875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:58.962557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c764c-9d67-444f-b2f9-e932c3384d8b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:59.001637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:59.002436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:59.002615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:59.002902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:59.003667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:59.003983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:59.005393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:59.015370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 647/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jun 15 22:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:59.021992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:59.131151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60793713-2ebb-4dd1-a5e4-393f1b6966e7 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:59.166955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:59.167827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:59.168661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:59.168966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:59.182252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:59.184466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:05:59.203025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:59.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:59.204862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:05:59.204862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:05:59.204862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:05:59.204862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:59.204862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 631/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:59.211109 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:59.321919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eb3a5-5516-42f2-9e5c-4d5058fa3e0c None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:59.358589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:59.359272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:59.359554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:59.359830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:59.360567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:59.360908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:59.362332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:59.375394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 648/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:59.382224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:59.423710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:59.507033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0dedb5-0c5d-4456-8251-2d59fe2597a1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:59.543153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:59.543981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:59.544264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:59.544539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:59.553252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:59.554972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 22:05:59.571791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:05:59.573007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:05:59.574351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 632/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:05:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:05:59.579346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:59.583394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:59.697442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad48792-7f5a-41d3-ae24-aa4179957f79 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:59.736761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:59.737491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:59.737770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:59.738042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:05:59.738901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:05:59.739210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:05:59.740702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:05:59.761706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 649/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jun 15 22:05:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:05:59.767840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:05:59.875515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:05:59.887326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f024e-8ac3-40ac-a642-f1ffcabb4ce2 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:05:59.924711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:05:59.925386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:05:59.925669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:05:59.925949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:00.005511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:00.006881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:00.102971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:00.115011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 633/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jun 15 22:05:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 22:06:00.121127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:00.187406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:00.230795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9b5e1-f407-4401-ba97-485bf61170e8 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:00.266503 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:00.267214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:00.267494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:00.267770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:00.279320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:00.280807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 22:06:00.300307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:06:00.301532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:06:00.302448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 22:06:00.302448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 22:06:00.302448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 22:06:00.302448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:06:00.302448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 650/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:06:00.307436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:00.413463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14838013-3a10-4f01-bf01-f6d276856688 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:00.452113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:00.452786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:00.453063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:00.453354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:00.454075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:00.454378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:00.455783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:00.468222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 634/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jun 15 22:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:00.474347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:00.577861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40895bf-c7f8-4168-87f4-565cdd022e40 None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:00.592312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:00.613171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:00.614019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:00.614304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:00.614580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:00.621477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:00.622935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 22:06:00.636810 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application with Lock( Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:06:00.637881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: ERROR keystone.server.flask.application Jun 15 22:06:00.638997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 651/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jun 15 22:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:06:00.644277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:00.699316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:00.754013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060d171-9e33-4b31-bb7b-b49a9ff593f1 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:00.789822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:00.790484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:00.790739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:00.791039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:00.791832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:00.792142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:00.793734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a7406-2237-45d8-bb22-309742888b52 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:00.806363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 635/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jun 15 22:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:00.812842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:00.917172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8d43-8327-4db1-ac0e-b7ac46f27dbf None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:00.959647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:00.960536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:00.960944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:00.961249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:00.962495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] RBAC: Adding query filter params (role.id=24c83faa9d6c4e329ea36d0c60d33d34, scope.project.id=eb3dc60f951d4948b213ce7d5915c292, user.id=f07fe125a6a7414b9f2702cb75bf681e) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:00.962905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:00.964806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f8997-d9d5-451b-91d6-f391f560681d None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:00.973057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 652/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jun 15 22:06:00 2022] GET /identity/v3/role_assignments?user.id=f07fe125a6a7414b9f2702cb75bf681e&scope.project.id=eb3dc60f951d4948b213ce7d5915c292&role.id=24c83faa9d6c4e329ea36d0c60d33d34 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:03.134402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0f09-b95c-4bc0-b6b6-b637d0f697c1 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:03.135035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0f09-b95c-4bc0-b6b6-b637d0f697c1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:03.135035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0f09-b95c-4bc0-b6b6-b637d0f697c1 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:03.136418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 636/1288] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:06:03.142806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:03.143378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:03.143378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:03.161989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:06:03.163634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:06:03.196434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:03.236854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 653/1289] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:06:03.259898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0f09-b95c-4bc0-b6b6-b637d0f697c1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:03.370458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0f09-b95c-4bc0-b6b6-b637d0f697c1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:03.381651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:03.406593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:03.407778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:03.408029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:03.408324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:03.408973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:03.410384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:06:03.422594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:06:03.423787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:03.424795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 637/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:06:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:06:03.430120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:03.533989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f4e37-ae28-4939-ad6c-73c1f05ffdde None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:03.568974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:03.569673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:03.569952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:03.570229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:03.570944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] RBAC: Adding query filter params (name=placement) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:03.571359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:03.572646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb302cf-d099-465e-bdd1-b8d0fdce0aea None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:03.577931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 654/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 15 22:06:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:03.583939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:03.685292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485f56c-02d2-4150-b55a-e77cc8c4321b None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:03.721399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:03.721867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:03.722166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:03.722566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] PATH_INFO: `/v3/services` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:03.723161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] RBAC: Adding query filter params (type=placement) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:03.723469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:03.724829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b50cc0-ebc5-4066-9f3a-54fe7efed4bf None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:03.729869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 638/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 15 22:06:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:05.894482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55885e7-2662-4029-8188-f6ac04512eb2 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:05.895069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55885e7-2662-4029-8188-f6ac04512eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:05.895069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55885e7-2662-4029-8188-f6ac04512eb2 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:05.896395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 655/1293] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:06:05.902422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733738f4-1c36-41af-a42a-efe72ced2b20 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:05.903581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733738f4-1c36-41af-a42a-efe72ced2b20 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:05.903865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733738f4-1c36-41af-a42a-efe72ced2b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:05.921868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-733738f4-1c36-41af-a42a-efe72ced2b20 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:06:05.923041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-733738f4-1c36-41af-a42a-efe72ced2b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:06:05.955254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:06.000493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 639/1294] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:06:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 22:06:06.025277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55885e7-2662-4029-8188-f6ac04512eb2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:06.064490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:06.142748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55885e7-2662-4029-8188-f6ac04512eb2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:06.181311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b0769-2bf3-410a-844a-669b6cd95bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:06.182029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b0769-2bf3-410a-844a-669b6cd95bbc None admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:06.182309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b0769-2bf3-410a-844a-669b6cd95bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:06.182585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b0769-2bf3-410a-844a-669b6cd95bbc None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:06.183334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b0769-2bf3-410a-844a-669b6cd95bbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:06.184725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b0769-2bf3-410a-844a-669b6cd95bbc None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:06.200717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 656/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jun 15 22:06:06 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:06:08.344990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70013-b5a2-4825-865b-380e2b593ea7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:08.345605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70013-b5a2-4825-865b-380e2b593ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:08.345605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a70013-b5a2-4825-865b-380e2b593ea7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:08.346949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 640/1296] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:06:08.352194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:08.352632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:08.352734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:08.370188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:06:08.371511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:06:08.447880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 657/1297] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:06:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:06:08.471123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70013-b5a2-4825-865b-380e2b593ea7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:08.578864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a70013-b5a2-4825-865b-380e2b593ea7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:08.615020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:08.615821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:08.616097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:08.616372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:08.617023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:08.618439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:06:08.630634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:06:08.631792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:08.632764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:08.636899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 641/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:06:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:06:08.638127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:08.657651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:08.742349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb9cc-400d-45cc-ab8e-0daa1479e4e6 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:08.780244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:08.780933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:08.781214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:08.781529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:08.782582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:08.782878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:08.784271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:08.789479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 658/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 15 22:06:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:06:08.796377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:08.832402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:08.905874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8990277-f068-4b6c-949b-b15faaad5a5e None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:08.941727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:08.942434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:08.942721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:08.943005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:08.943850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] RBAC: Adding query filter params (interface=public, service_id=81495f3df01a4ae4916a1a94f293bb41, region_id=RegionOne) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:08.944149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:08.945622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bf5c8-9014-497c-b7d7-fd15cd2d7223 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:08.951567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 642/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jun 15 22:06:08 2022] GET /identity/v3/endpoints?service_id=81495f3df01a4ae4916a1a94f293bb41&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:08.958578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:09.058621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:09.078179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e6562-8594-41a1-98bc-c0a66cec39aa None admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:09.115700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23029424-dddb-4074-ad5c-782cf8a19ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:09.116091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23029424-dddb-4074-ad5c-782cf8a19ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:09.116374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23029424-dddb-4074-ad5c-782cf8a19ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:09.116646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23029424-dddb-4074-ad5c-782cf8a19ec8 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:09.117365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23029424-dddb-4074-ad5c-782cf8a19ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:09.118789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23029424-dddb-4074-ad5c-782cf8a19ec8 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:09.126796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 659/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jun 15 22:06:08 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:06:11.240219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf35068-a70e-4b52-a5dd-fc6a1134bb73 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:11.240712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf35068-a70e-4b52-a5dd-fc6a1134bb73 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:11.240809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf35068-a70e-4b52-a5dd-fc6a1134bb73 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:11.242166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 643/1302] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:06:11.247648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:11.248113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:11.248204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:11.266294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:06:11.267504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:06:11.343420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 660/1303] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:06:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 22:06:11.367111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf35068-a70e-4b52-a5dd-fc6a1134bb73 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:11.479309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:11.487536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf35068-a70e-4b52-a5dd-fc6a1134bb73 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:11.526362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:11.527249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:11.527516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:11.527792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:11.528451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:11.529871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 22:06:11.542671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 22:06:11.545754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application with Lock( Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self._enter() Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application return self.creator() Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application created_value = creator( Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: ERROR keystone.server.flask.application Jun 15 22:06:11.546798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 644/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jun 15 22:06:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 22:06:11.550371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:11.633922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:11.661478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f8ab-33f0-470d-979d-728ddf2efa21 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:11.701788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:11.702470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:11.702746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:11.703017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] PATH_INFO: `/v3/services` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:11.703860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:06:11.704141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:11.705598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd34d-0a8d-4aa7-93c6-fa993f95ac09 None admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:11.711758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 661/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jun 15 22:06:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:06:11.718427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:06:11.827999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeedb3e-0eeb-4c9d-b3c9-decb60ed8055 None admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:06:11.863514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeab1ef-2210-4716-9190-b9732f3ba86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:06:11.864174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab1ef-2210-4716-9190-b9732f3ba86d None admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:06:11.864451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab1ef-2210-4716-9190-b9732f3ba86d None admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:06:11.864723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeab1ef-2210-4716-9190-b9732f3ba86d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:06:11.865492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeab1ef-2210-4716-9190-b9732f3ba86d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:06:11.866868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeab1ef-2210-4716-9190-b9732f3ba86d None admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:06:11.887113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 645/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jun 15 22:06:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:06:21.708239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=30 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:06:21.882926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:17.156541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d999c6-76bf-4ad6-86e5-7fe7a134933b None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:17.158563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d999c6-76bf-4ad6-86e5-7fe7a134933b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:17.159931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d999c6-76bf-4ad6-86e5-7fe7a134933b None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:17.176579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93c699-80d0-4086-b44a-e377dd201c55 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:17.177043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93c699-80d0-4086-b44a-e377dd201c55 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:17.177344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93c699-80d0-4086-b44a-e377dd201c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:17.182177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 662/1307] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:17 2022] GET /identity => generated 270 bytes in 37 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:17.359774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1b93c699-80d0-4086-b44a-e377dd201c55 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:17.361017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1b93c699-80d0-4086-b44a-e377dd201c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:17.486168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 646/1308] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:17.542628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7f89-ba00-4aa3-af2c-c95e9bda9091 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:17.543343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7f89-ba00-4aa3-af2c-c95e9bda9091 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:17.543701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7f89-ba00-4aa3-af2c-c95e9bda9091 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:17.545920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 663/1309] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jun 15 22:07:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:17.553568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea3a3c-b18b-450e-ad08-41170bc455d3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:17.553851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea3a3c-b18b-450e-ad08-41170bc455d3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:17.554147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea3a3c-b18b-450e-ad08-41170bc455d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:17.646753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-34ea3a3c-b18b-450e-ad08-41170bc455d3 None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:17.647909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-34ea3a3c-b18b-450e-ad08-41170bc455d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:17.671879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:17.732704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 647/1310] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jun 15 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:17.742215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7f89-ba00-4aa3-af2c-c95e9bda9091 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:17.744965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c82d7f89-ba00-4aa3-af2c-c95e9bda9091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:17.898604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7f89-ba00-4aa3-af2c-c95e9bda9091 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:17.996247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:17.996937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:17.997230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:17.997539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:17.999245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:18.064723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:18.147736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:18.149817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c215f-92e2-4717-9d20-51abdf87bd90 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:18.177138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 664/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:20.732890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6d86-5c5d-44e6-a228-1fa4d5d07774 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:20.733531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6d86-5c5d-44e6-a228-1fa4d5d07774 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:20.733531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6d86-5c5d-44e6-a228-1fa4d5d07774 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:20.734889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 648/1312] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:20.740601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecef86-8479-495b-84e0-b4a0b3e5852c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:20.741099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecef86-8479-495b-84e0-b4a0b3e5852c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:20.741243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecef86-8479-495b-84e0-b4a0b3e5852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:20.820569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f9ecef86-8479-495b-84e0-b4a0b3e5852c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:20.821870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f9ecef86-8479-495b-84e0-b4a0b3e5852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:20.926911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 665/1313] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:20.966694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd6d86-5c5d-44e6-a228-1fa4d5d07774 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:20.968250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-05bd6d86-5c5d-44e6-a228-1fa4d5d07774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:21.082692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd6d86-5c5d-44e6-a228-1fa4d5d07774 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:21.157131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:21.159929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:21.160604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:21.161077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:21.161590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:21.163454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:21.282442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:21.283922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f683f45-b255-44c5-821e-6e8b3a1d044b service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:21.303214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 649/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:23.779878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294124c0-215c-48c8-acb4-48b4889b67cb None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:23.780812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294124c0-215c-48c8-acb4-48b4889b67cb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:23.780812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294124c0-215c-48c8-acb4-48b4889b67cb None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:23.782244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 666/1315] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:23.787801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0ad2-923a-44ae-9b0b-80d83583edc0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:23.788253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0ad2-923a-44ae-9b0b-80d83583edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:23.788348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0ad2-923a-44ae-9b0b-80d83583edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:23.871196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9a5b0ad2-923a-44ae-9b0b-80d83583edc0 None None] MFA Rules not processed for user `027a7e4e27d9446295cfe7447b23dd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:23.872443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9a5b0ad2-923a-44ae-9b0b-80d83583edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:23.931539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:23.980184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 650/1316] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:24.019326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294124c0-215c-48c8-acb4-48b4889b67cb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:24.020919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-294124c0-215c-48c8-acb4-48b4889b67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:24.032016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:24.132220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294124c0-215c-48c8-acb4-48b4889b67cb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:24.211173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:24.211830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:24.212114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:24.212391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:24.214351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:24.283955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:24.334818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:24.336279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef30a6-8b05-442f-940d-15077bf9d82f service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:24.355816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 667/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:27.118912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89aad-487a-4724-aaaa-3d5fca855a7d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:27.119485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89aad-487a-4724-aaaa-3d5fca855a7d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:27.119583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b89aad-487a-4724-aaaa-3d5fca855a7d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:27.120934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 651/1318] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:27.126494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cfe36-25f4-4b64-ad5c-255528a956d2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:27.126893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cfe36-25f4-4b64-ad5c-255528a956d2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:27.127052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cfe36-25f4-4b64-ad5c-255528a956d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:27.193386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-104cfe36-25f4-4b64-ad5c-255528a956d2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:27.194770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-104cfe36-25f4-4b64-ad5c-255528a956d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:27.295814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 668/1319] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:27.334312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b89aad-487a-4724-aaaa-3d5fca855a7d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:27.335859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f3b89aad-487a-4724-aaaa-3d5fca855a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:27.445418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b89aad-487a-4724-aaaa-3d5fca855a7d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:27.521783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:27.522454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:27.522739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:27.523013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:27.524692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:27.533285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:27.640729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:27.642141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836bb87e-dbf1-4768-95ba-8f555dae2daf service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:27.662049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 652/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:30.511902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf934-f7f1-4b11-8945-403890e40ad8 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:30.512441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf934-f7f1-4b11-8945-403890e40ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:30.512441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcf934-f7f1-4b11-8945-403890e40ad8 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:30.513813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 669/1321] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:30.519767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4edf-5bba-4fdb-8243-a5a159fac338 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:30.520284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4edf-5bba-4fdb-8243-a5a159fac338 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:30.520444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4edf-5bba-4fdb-8243-a5a159fac338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:30.601944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c03f4edf-5bba-4fdb-8243-a5a159fac338 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:30.603555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c03f4edf-5bba-4fdb-8243-a5a159fac338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:30.675813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:30.723500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 653/1322] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:30.759739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf934-f7f1-4b11-8945-403890e40ad8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:30.761473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-15dcf934-f7f1-4b11-8945-403890e40ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:30.782965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:30.876407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcf934-f7f1-4b11-8945-403890e40ad8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:30.961655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:30.962465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:30.962768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:30.963043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:30.964883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:31.049362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:31.092539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:31.094048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195083d-26d1-48d9-97d6-dd7b091eae7c service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:31.113968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 670/1323] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:33.308910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692203c-85bf-46b8-a4a2-1c228de2e19c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:33.309669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692203c-85bf-46b8-a4a2-1c228de2e19c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:33.309669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692203c-85bf-46b8-a4a2-1c228de2e19c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:33.310931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 654/1324] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:33.316671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7557-1330-45c7-be17-cf9bd57d515b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:33.317143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7557-1330-45c7-be17-cf9bd57d515b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:33.317246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac7557-1330-45c7-be17-cf9bd57d515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:33.386557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-23ac7557-1330-45c7-be17-cf9bd57d515b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:33.387780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-23ac7557-1330-45c7-be17-cf9bd57d515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:33.490266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 671/1325] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:33.542228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3222-f075-494a-9c1b-bdc345b15cb2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:33.542598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3222-f075-494a-9c1b-bdc345b15cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:33.542940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3222-f075-494a-9c1b-bdc345b15cb2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:33.544815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 655/1326] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jun 15 22:07:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:33.550997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d56e25-f9b5-4466-bd18-b26e3771ad74 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:33.551223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d56e25-f9b5-4466-bd18-b26e3771ad74 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:33.551388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d56e25-f9b5-4466-bd18-b26e3771ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:33.582640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:33.636202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b5d56e25-f9b5-4466-bd18-b26e3771ad74 None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:33.637497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b5d56e25-f9b5-4466-bd18-b26e3771ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:33.724780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 672/1327] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jun 15 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:33.736770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc3222-f075-494a-9c1b-bdc345b15cb2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:33.742386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d3fc3222-f075-494a-9c1b-bdc345b15cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:33.866855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc3222-f075-494a-9c1b-bdc345b15cb2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:33.946356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:33.947100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:33.947415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:33.947700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:33.949782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:33.969261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:34.070207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:34.071634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd085ce1-1e9c-4198-b27c-5048a21136e1 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:34.091272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 656/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:36.512542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e7819-f8af-4311-8fda-c25ccca56c49 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:36.513078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e7819-f8af-4311-8fda-c25ccca56c49 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:36.513078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e7819-f8af-4311-8fda-c25ccca56c49 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:36.514557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 673/1329] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:36.520223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45081-4ea7-4778-8ce4-7e908811bcd8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:36.520716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45081-4ea7-4778-8ce4-7e908811bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:36.520716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c45081-4ea7-4778-8ce4-7e908811bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:36.588632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-53c45081-4ea7-4778-8ce4-7e908811bcd8 None None] MFA Rules not processed for user `027a7e4e27d9446295cfe7447b23dd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:36.589975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-53c45081-4ea7-4778-8ce4-7e908811bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:36.657718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:36.692741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 657/1330] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:36.730227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e7819-f8af-4311-8fda-c25ccca56c49 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:36.731704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8d2e7819-f8af-4311-8fda-c25ccca56c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:36.842228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e7819-f8af-4311-8fda-c25ccca56c49 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:36.862698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:36.920017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:36.920664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:36.920937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:36.921204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:36.922868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:37.045232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:37.046773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d3fd1-7860-4ea1-827c-fe16a0e0840b service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:37.068913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 674/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:39.496835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4627b-0e58-4aed-bd69-67cf64295a03 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:39.497450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4627b-0e58-4aed-bd69-67cf64295a03 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:39.497548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4627b-0e58-4aed-bd69-67cf64295a03 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:39.499021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 658/1332] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:39.504500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6975d7-3559-44ed-9f37-2b871302f8bd None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:39.504950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6975d7-3559-44ed-9f37-2b871302f8bd None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:39.505063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6975d7-3559-44ed-9f37-2b871302f8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:39.568510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:39.571487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ab6975d7-3559-44ed-9f37-2b871302f8bd None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:39.573447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ab6975d7-3559-44ed-9f37-2b871302f8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:39.672699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 675/1333] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:39.708664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4627b-0e58-4aed-bd69-67cf64295a03 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:39.710285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c3f4627b-0e58-4aed-bd69-67cf64295a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:39.828260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4627b-0e58-4aed-bd69-67cf64295a03 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:39.908759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:39.909445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:39.909723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:39.909992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:39.911652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:39.940692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:40.034255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:40.035704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeee3c5-8bb3-4f10-ae1b-933f387c1fc6 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:40.055835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 659/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:42.254894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d05c-bcfb-4890-83b1-7730cfc40e0d None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:42.255692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d05c-bcfb-4890-83b1-7730cfc40e0d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:42.255692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d05c-bcfb-4890-83b1-7730cfc40e0d None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:42.256843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 676/1335] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:42.262591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c6fe-a206-4b5b-87ca-ff93dd976ff7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:42.263034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c6fe-a206-4b5b-87ca-ff93dd976ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:42.263123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5c6fe-a206-4b5b-87ca-ff93dd976ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:42.339353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a5f5c6fe-a206-4b5b-87ca-ff93dd976ff7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:42.340608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a5f5c6fe-a206-4b5b-87ca-ff93dd976ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:42.419865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:42.445176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 660/1336] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:42.485931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d05c-bcfb-4890-83b1-7730cfc40e0d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:42.487427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3e84d05c-bcfb-4890-83b1-7730cfc40e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:42.596310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d05c-bcfb-4890-83b1-7730cfc40e0d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:42.626103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:42.675792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:42.676452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:42.676737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:42.677001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:42.678693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:42.795572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:42.797065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d34857-8538-40c7-8ae9-efca8ddd0022 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:42.817078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 677/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:45.342605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598c5f4-587b-4792-969c-1872a17ca56c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:45.342605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598c5f4-587b-4792-969c-1872a17ca56c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:45.343220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598c5f4-587b-4792-969c-1872a17ca56c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:45.344296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 661/1338] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:45.350029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f484-cf38-4532-a0ae-7e4a1ca2f45e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:45.350783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f484-cf38-4532-a0ae-7e4a1ca2f45e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:45.350964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f484-cf38-4532-a0ae-7e4a1ca2f45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:45.424320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b417f484-cf38-4532-a0ae-7e4a1ca2f45e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:45.425563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b417f484-cf38-4532-a0ae-7e4a1ca2f45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:45.434953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:45.531545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 678/1339] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:45.572706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598c5f4-587b-4792-969c-1872a17ca56c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:45.574280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f598c5f4-587b-4792-969c-1872a17ca56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:45.695361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598c5f4-587b-4792-969c-1872a17ca56c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:45.785159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:45.785845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:45.786126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:45.786394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:45.788053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:45.825811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:45.914627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:45.916151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db5dc2-2d4c-4461-af91-70a9c451b51f service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:45.934891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 662/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:07:50.123276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee9388-5dfc-4433-a1b9-8e7810d3c11e None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:50.123838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee9388-5dfc-4433-a1b9-8e7810d3c11e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:50.123838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee9388-5dfc-4433-a1b9-8e7810d3c11e None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:50.125107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 679/1341] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:07:50.130636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fde12-a97f-459d-ac6f-bc8d08feeaee None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:50.131175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fde12-a97f-459d-ac6f-bc8d08feeaee None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:50.131344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66fde12-a97f-459d-ac6f-bc8d08feeaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:50.209056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f66fde12-a97f-459d-ac6f-bc8d08feeaee None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:50.210254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f66fde12-a97f-459d-ac6f-bc8d08feeaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:50.319718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:50.334382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 663/1342] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:50.373253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee9388-5dfc-4433-a1b9-8e7810d3c11e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:50.375917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9bee9388-5dfc-4433-a1b9-8e7810d3c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:50.476922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee9388-5dfc-4433-a1b9-8e7810d3c11e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:50.481299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747b2c-4c1d-415b-89ce-b84cfb1e512e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:50.481995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747b2c-4c1d-415b-89ce-b84cfb1e512e service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:50.482277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747b2c-4c1d-415b-89ce-b84cfb1e512e service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:50.482550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747b2c-4c1d-415b-89ce-b84cfb1e512e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:50.493204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b747b2c-4c1d-415b-89ce-b84cfb1e512e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:50.494705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b747b2c-4c1d-415b-89ce-b84cfb1e512e service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:50.504727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 680/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:53.319978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f240041-5012-4a36-9f8a-5dc1ffa31c0c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:53.320709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f240041-5012-4a36-9f8a-5dc1ffa31c0c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:53.320709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f240041-5012-4a36-9f8a-5dc1ffa31c0c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:53.322086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 664/1344] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:53.328154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e03e1-f360-4a80-b7d7-998d75c71052 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:53.328892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e03e1-f360-4a80-b7d7-998d75c71052 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:53.328892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e03e1-f360-4a80-b7d7-998d75c71052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:53.361219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4f4e03e1-f360-4a80-b7d7-998d75c71052 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:53.362513 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4f4e03e1-f360-4a80-b7d7-998d75c71052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:53.395238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:07:53.473562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 681/1345] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:53.511325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f240041-5012-4a36-9f8a-5dc1ffa31c0c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:53.522992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f240041-5012-4a36-9f8a-5dc1ffa31c0c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:53.527089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685f77b-94e7-482d-ab69-b67c5562600d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:53.528098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f77b-94e7-482d-ab69-b67c5562600d service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:53.528098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f77b-94e7-482d-ab69-b67c5562600d service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:53.528312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685f77b-94e7-482d-ab69-b67c5562600d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:53.539060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685f77b-94e7-482d-ab69-b67c5562600d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:53.540839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685f77b-94e7-482d-ab69-b67c5562600d service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:53.552052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 665/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:07:57.751178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65681bd-5619-4b9e-a940-a67377c3bdd7 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:57.751682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65681bd-5619-4b9e-a940-a67377c3bdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:57.751682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65681bd-5619-4b9e-a940-a67377c3bdd7 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:57.753134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 682/1347] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:07:57.758816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7cee7-f18f-4f95-8b79-81e7b1d83ab2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:57.759323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7cee7-f18f-4f95-8b79-81e7b1d83ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:57.759719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7cee7-f18f-4f95-8b79-81e7b1d83ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:57.778628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bcc7cee7-f18f-4f95-8b79-81e7b1d83ab2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:07:57.780250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bcc7cee7-f18f-4f95-8b79-81e7b1d83ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:07:57.789356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 666/1348] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:07:57.827719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65681bd-5619-4b9e-a940-a67377c3bdd7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:07:57.840557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65681bd-5619-4b9e-a940-a67377c3bdd7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:07:57.844447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8e25-7ea5-4062-a1aa-0bad0861d1a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:07:57.845114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8e25-7ea5-4062-a1aa-0bad0861d1a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:07:57.845428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8e25-7ea5-4062-a1aa-0bad0861d1a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:07:57.845711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8e25-7ea5-4062-a1aa-0bad0861d1a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:07:57.855306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8e25-7ea5-4062-a1aa-0bad0861d1a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:07:57.856954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8e25-7ea5-4062-a1aa-0bad0861d1a5 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:07:57.867050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 683/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:03.031823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a017b-415f-46d3-a842-b3d6f1c9b13a None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:03.032741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a017b-415f-46d3-a842-b3d6f1c9b13a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:03.033287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a017b-415f-46d3-a842-b3d6f1c9b13a None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:03.035171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 667/1350] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:03.040332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017491-226e-498c-85cf-968e98dfb2a1 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:03.040847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017491-226e-498c-85cf-968e98dfb2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:03.041220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8017491-226e-498c-85cf-968e98dfb2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:03.131461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c8017491-226e-498c-85cf-968e98dfb2a1 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:03.133106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c8017491-226e-498c-85cf-968e98dfb2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:03.249135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 684/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:07.552285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2990d-b17e-4a77-a96c-5464fe60af83 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:07.552969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2990d-b17e-4a77-a96c-5464fe60af83 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:07.552969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2990d-b17e-4a77-a96c-5464fe60af83 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:07.554559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 668/1352] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:07.561192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db0b2-8e3d-4f28-a5df-ecd98cf2066e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:07.561816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db0b2-8e3d-4f28-a5df-ecd98cf2066e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:07.562035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47db0b2-8e3d-4f28-a5df-ecd98cf2066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:07.583692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e47db0b2-8e3d-4f28-a5df-ecd98cf2066e None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:07.585264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e47db0b2-8e3d-4f28-a5df-ecd98cf2066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:07.595443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 685/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:08:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:07.772802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=13 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:09.136407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9190b-28a2-4dc6-add8-154b49880fc7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:09.137069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9190b-28a2-4dc6-add8-154b49880fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:09.137069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9190b-28a2-4dc6-add8-154b49880fc7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:09.138325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 669/1354] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:09.143663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd342-e0ac-4c84-baac-bb77c6b0b61e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:09.144121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd342-e0ac-4c84-baac-bb77c6b0b61e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:09.144227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd342-e0ac-4c84-baac-bb77c6b0b61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:09.163739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-aefdd342-e0ac-4c84-baac-bb77c6b0b61e None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:09.164878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aefdd342-e0ac-4c84-baac-bb77c6b0b61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:09.174764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 686/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:08:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:12.934312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353423f7-9d8a-4897-818b-71dc3cf81182 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:12.934852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353423f7-9d8a-4897-818b-71dc3cf81182 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:12.934852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353423f7-9d8a-4897-818b-71dc3cf81182 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:12.936240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 670/1356] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:12.942131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1717c7-af84-48b6-9a0f-8853f667de91 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:12.942728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1717c7-af84-48b6-9a0f-8853f667de91 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:12.942929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1717c7-af84-48b6-9a0f-8853f667de91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:12.963945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6f1717c7-af84-48b6-9a0f-8853f667de91 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:12.965171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6f1717c7-af84-48b6-9a0f-8853f667de91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:12.977713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 687/1357] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:13.030141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611edc6-eb1e-4028-945c-12391f04a96d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:13.031128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611edc6-eb1e-4028-945c-12391f04a96d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:13.031504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611edc6-eb1e-4028-945c-12391f04a96d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:13.033467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 671/1358] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 15 22:08:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:13.043209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4394b-f569-45e1-a83e-e6c456c48776 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:13.043504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4394b-f569-45e1-a83e-e6c456c48776 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:13.043992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4394b-f569-45e1-a83e-e6c456c48776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:13.097680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:13.107791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a0f4394b-f569-45e1-a83e-e6c456c48776 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:13.109380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a0f4394b-f569-45e1-a83e-e6c456c48776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:13.208202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 688/1359] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 15 22:08:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:08:13.216240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611edc6-eb1e-4028-945c-12391f04a96d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:13.244854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611edc6-eb1e-4028-945c-12391f04a96d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:13.250744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78b54-7893-43c8-b999-38e242c931fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:13.251621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78b54-7893-43c8-b999-38e242c931fa service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:13.252061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78b54-7893-43c8-b999-38e242c931fa service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:13.252555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78b54-7893-43c8-b999-38e242c931fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:13.262674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78b54-7893-43c8-b999-38e242c931fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:13.264533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78b54-7893-43c8-b999-38e242c931fa service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:13.276743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 672/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:15.664982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a74fe-e4a9-494b-a289-2f98e2248dec None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:15.665871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a74fe-e4a9-494b-a289-2f98e2248dec None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:15.665871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a74fe-e4a9-494b-a289-2f98e2248dec None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:15.667080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 689/1361] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:15.673609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42239e-e730-4203-94cd-a725557fdf94 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:15.674182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42239e-e730-4203-94cd-a725557fdf94 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:15.674182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42239e-e730-4203-94cd-a725557fdf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:15.695617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0c42239e-e730-4203-94cd-a725557fdf94 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:15.697469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0c42239e-e730-4203-94cd-a725557fdf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:15.707518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 673/1362] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:15.754719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a74fe-e4a9-494b-a289-2f98e2248dec None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:15.771977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a74fe-e4a9-494b-a289-2f98e2248dec None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:15.779013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726d259-7272-4588-a1c1-2877593664f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:15.779944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d259-7272-4588-a1c1-2877593664f1 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:15.780726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d259-7272-4588-a1c1-2877593664f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:15.781004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d259-7272-4588-a1c1-2877593664f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:15.790830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d259-7272-4588-a1c1-2877593664f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:15.792510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d259-7272-4588-a1c1-2877593664f1 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:15.803851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 690/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:18.282944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e84f09-5a2b-4339-9638-57ba8af0fda2 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:18.283447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e84f09-5a2b-4339-9638-57ba8af0fda2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:18.283447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e84f09-5a2b-4339-9638-57ba8af0fda2 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:18.284787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 674/1364] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:18.290368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab959d-2987-4f16-945f-8e3905749d18 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:18.291007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab959d-2987-4f16-945f-8e3905749d18 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:18.291249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab959d-2987-4f16-945f-8e3905749d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:18.311488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-75ab959d-2987-4f16-945f-8e3905749d18 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:18.312748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-75ab959d-2987-4f16-945f-8e3905749d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:18.323484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 691/1365] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:18.373723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedac15-c8d3-4bbd-932a-c8c83ca5f428 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:18.373963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedac15-c8d3-4bbd-932a-c8c83ca5f428 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:18.374273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedac15-c8d3-4bbd-932a-c8c83ca5f428 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:18.375672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 675/1366] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 15 22:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:18.382364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9953-4c74-42cc-a024-fa40bfe08b8a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:18.382896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9953-4c74-42cc-a024-fa40bfe08b8a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:18.383377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9953-4c74-42cc-a024-fa40bfe08b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:18.407396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-806b9953-4c74-42cc-a024-fa40bfe08b8a None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:18.408765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-806b9953-4c74-42cc-a024-fa40bfe08b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:18.418505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 692/1367] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 15 22:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:18.426572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedac15-c8d3-4bbd-932a-c8c83ca5f428 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:18.442684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedac15-c8d3-4bbd-932a-c8c83ca5f428 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:18.449535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60edfd-fa4f-4cf4-914a-8ccd0d9e1784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:18.450219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60edfd-fa4f-4cf4-914a-8ccd0d9e1784 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:18.450504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60edfd-fa4f-4cf4-914a-8ccd0d9e1784 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:18.452637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60edfd-fa4f-4cf4-914a-8ccd0d9e1784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:18.467931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60edfd-fa4f-4cf4-914a-8ccd0d9e1784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:18.473051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60edfd-fa4f-4cf4-914a-8ccd0d9e1784 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:18.481681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 676/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:20.810977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e1b5-ed82-4e97-a0d6-1b50509c96ca None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:20.811606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e1b5-ed82-4e97-a0d6-1b50509c96ca None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:20.811606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e1b5-ed82-4e97-a0d6-1b50509c96ca None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:20.812915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 693/1369] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:20.818560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a3544-98f0-4d12-b8d9-ee7fd69ad934 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:20.819030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a3544-98f0-4d12-b8d9-ee7fd69ad934 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:20.819112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a3544-98f0-4d12-b8d9-ee7fd69ad934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:20.837979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ef1a3544-98f0-4d12-b8d9-ee7fd69ad934 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:20.839082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ef1a3544-98f0-4d12-b8d9-ee7fd69ad934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:20.847511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 677/1370] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:20.892745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48e1b5-ed82-4e97-a0d6-1b50509c96ca None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:20.909070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48e1b5-ed82-4e97-a0d6-1b50509c96ca None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:20.914870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ea2c1-6144-4c5c-9734-910026db78ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:20.915672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ea2c1-6144-4c5c-9734-910026db78ab service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:20.916066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ea2c1-6144-4c5c-9734-910026db78ab service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:20.916522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ea2c1-6144-4c5c-9734-910026db78ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:20.926286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ea2c1-6144-4c5c-9734-910026db78ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:20.928003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ea2c1-6144-4c5c-9734-910026db78ab service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:20.942267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 694/1371] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:21.300635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547353-9d5b-4e58-8ec1-d260dc0f5cd0 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:21.301173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547353-9d5b-4e58-8ec1-d260dc0f5cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:21.301476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3547353-9d5b-4e58-8ec1-d260dc0f5cd0 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:21.303068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 678/1372] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:21.308897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867af268-3909-4657-a2c8-332b546d0280 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:21.309452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867af268-3909-4657-a2c8-332b546d0280 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:21.309902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867af268-3909-4657-a2c8-332b546d0280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:21.329415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-867af268-3909-4657-a2c8-332b546d0280 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:21.330649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-867af268-3909-4657-a2c8-332b546d0280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:21.341471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 695/1373] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:21.643966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be24994-b228-4253-8371-28764fabdbce None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:21.643966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be24994-b228-4253-8371-28764fabdbce None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:21.643966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be24994-b228-4253-8371-28764fabdbce None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:21.645648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 679/1374] 10.222.0.55 () {54 vars in 963 bytes} [Wed Jun 15 22:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:21.651410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dac2-7b0d-4af5-9456-1c282a3637f5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:21.651740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dac2-7b0d-4af5-9456-1c282a3637f5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:21.652045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dac2-7b0d-4af5-9456-1c282a3637f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:21.710750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f342dac2-7b0d-4af5-9456-1c282a3637f5 None None] MFA Rules not processed for user `85cfb11b9f0e4b0eb5078ab7a14948ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:21.712101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f342dac2-7b0d-4af5-9456-1c282a3637f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:21.777355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 696/1375] 10.222.0.55 () {58 vars in 1060 bytes} [Wed Jun 15 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:21.785790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be24994-b228-4253-8371-28764fabdbce None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:21.797221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be24994-b228-4253-8371-28764fabdbce None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:21.800949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf89eda-9e0f-4497-b8bf-ab7db56e3f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:21.801647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf89eda-9e0f-4497-b8bf-ab7db56e3f24 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:21.801935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf89eda-9e0f-4497-b8bf-ab7db56e3f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:21.802214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf89eda-9e0f-4497-b8bf-ab7db56e3f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:21.812328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf89eda-9e0f-4497-b8bf-ab7db56e3f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:21.813831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf89eda-9e0f-4497-b8bf-ab7db56e3f24 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:21.824316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 680/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:23.197789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd809e-7640-42dc-92cb-c77e86d8ad05 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:23.198352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd809e-7640-42dc-92cb-c77e86d8ad05 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:23.198473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd809e-7640-42dc-92cb-c77e86d8ad05 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:23.199899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 697/1377] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:23.205692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ce399-1512-4232-94a0-70a590937edd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:23.206152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ce399-1512-4232-94a0-70a590937edd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:23.206266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ce399-1512-4232-94a0-70a590937edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:23.224886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-260ce399-1512-4232-94a0-70a590937edd None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:23.226199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-260ce399-1512-4232-94a0-70a590937edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:23.239921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 681/1378] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:23.284706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd809e-7640-42dc-92cb-c77e86d8ad05 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:23.300926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd809e-7640-42dc-92cb-c77e86d8ad05 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:23.308540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f678-2c7b-4da0-957f-d721d290b084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:23.309235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f678-2c7b-4da0-957f-d721d290b084 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:23.309759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f678-2c7b-4da0-957f-d721d290b084 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:23.310049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f678-2c7b-4da0-957f-d721d290b084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:23.320035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f678-2c7b-4da0-957f-d721d290b084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:23.321732 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f678-2c7b-4da0-957f-d721d290b084 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:23.326967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:23.334729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 698/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:25.573727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3344e1-1667-4179-b8d4-86415d53650e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:25.574393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3344e1-1667-4179-b8d4-86415d53650e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:25.574393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3344e1-1667-4179-b8d4-86415d53650e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:25.575931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 682/1380] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:25.581854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3582-553a-4bd5-b120-29f9732597ae None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:25.582355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3582-553a-4bd5-b120-29f9732597ae None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:25.582739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da3582-553a-4bd5-b120-29f9732597ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:25.601748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-29da3582-553a-4bd5-b120-29f9732597ae None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:25.602930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-29da3582-553a-4bd5-b120-29f9732597ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:25.611378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 699/1381] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:25.657612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3344e1-1667-4179-b8d4-86415d53650e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:25.674700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3344e1-1667-4179-b8d4-86415d53650e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:25.680826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95cb3d-7874-4dd2-a24d-4f5c1cee0ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:25.682062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95cb3d-7874-4dd2-a24d-4f5c1cee0ca2 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:25.682465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95cb3d-7874-4dd2-a24d-4f5c1cee0ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:25.682838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95cb3d-7874-4dd2-a24d-4f5c1cee0ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:25.692529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95cb3d-7874-4dd2-a24d-4f5c1cee0ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:25.694296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95cb3d-7874-4dd2-a24d-4f5c1cee0ca2 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:25.704927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 683/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:27.976879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fd1e8-5303-48c1-a26c-bf37ac2c8a2a None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:27.977449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fd1e8-5303-48c1-a26c-bf37ac2c8a2a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:27.977694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fd1e8-5303-48c1-a26c-bf37ac2c8a2a None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:27.979452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 700/1383] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:27.985736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cf8ff-8140-46f4-bbde-fd0f71de4d5d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:27.986246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cf8ff-8140-46f4-bbde-fd0f71de4d5d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:27.986246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cf8ff-8140-46f4-bbde-fd0f71de4d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:28.006447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-450cf8ff-8140-46f4-bbde-fd0f71de4d5d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:28.014147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-450cf8ff-8140-46f4-bbde-fd0f71de4d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:28.021651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 684/1384] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:08:28.064038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fd1e8-5303-48c1-a26c-bf37ac2c8a2a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:28.079074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fd1e8-5303-48c1-a26c-bf37ac2c8a2a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:28.084512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c4625-2ab9-45d9-a258-cb9fec580920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:28.085188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c4625-2ab9-45d9-a258-cb9fec580920 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:28.085509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c4625-2ab9-45d9-a258-cb9fec580920 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:28.085795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c4625-2ab9-45d9-a258-cb9fec580920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:28.095485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c4625-2ab9-45d9-a258-cb9fec580920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:28.097105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c4625-2ab9-45d9-a258-cb9fec580920 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:28.107680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 701/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:30.543294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfd7c-b5c6-458a-947a-8398c519cf54 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:30.543929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfd7c-b5c6-458a-947a-8398c519cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:30.543929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfd7c-b5c6-458a-947a-8398c519cf54 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:30.545253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 685/1386] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:08:30.552789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96561b3-b528-402a-a3d9-68ebce40ba9e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:30.553384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96561b3-b528-402a-a3d9-68ebce40ba9e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:30.553384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96561b3-b528-402a-a3d9-68ebce40ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:30.573815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d96561b3-b528-402a-a3d9-68ebce40ba9e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:30.575143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d96561b3-b528-402a-a3d9-68ebce40ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:30.583949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 702/1387] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:30.642493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfd7c-b5c6-458a-947a-8398c519cf54 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:30.663769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfd7c-b5c6-458a-947a-8398c519cf54 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:30.671209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811556a-7cc6-4cda-b544-76bcb8836bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:30.671911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811556a-7cc6-4cda-b544-76bcb8836bec service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:30.672671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811556a-7cc6-4cda-b544-76bcb8836bec service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:30.672967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811556a-7cc6-4cda-b544-76bcb8836bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:30.683213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811556a-7cc6-4cda-b544-76bcb8836bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:30.684928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811556a-7cc6-4cda-b544-76bcb8836bec service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:30.696160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 686/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:33.067426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d6a9-10db-4e86-943f-8723f7fc9531 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:33.068819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d6a9-10db-4e86-943f-8723f7fc9531 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:33.068819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d6a9-10db-4e86-943f-8723f7fc9531 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:33.071033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 703/1389] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:33.080225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc1b24-b02a-4377-b1d2-62520819efe2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:33.081277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc1b24-b02a-4377-b1d2-62520819efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:33.081925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc1b24-b02a-4377-b1d2-62520819efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:33.108991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-7acc1b24-b02a-4377-b1d2-62520819efe2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:33.110340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7acc1b24-b02a-4377-b1d2-62520819efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:33.120621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 687/1390] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:08:33.182561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d6a9-10db-4e86-943f-8723f7fc9531 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:33.201287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d6a9-10db-4e86-943f-8723f7fc9531 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:33.209287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313800df-99f3-4ead-a9f2-9f94e825ed62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:33.210111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313800df-99f3-4ead-a9f2-9f94e825ed62 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:33.210471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313800df-99f3-4ead-a9f2-9f94e825ed62 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:33.210750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313800df-99f3-4ead-a9f2-9f94e825ed62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:33.221503 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313800df-99f3-4ead-a9f2-9f94e825ed62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:33.223577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313800df-99f3-4ead-a9f2-9f94e825ed62 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:33.248173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 704/1391] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:35.879575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ea70d-ed6f-4f99-ad65-83919268a7c6 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:35.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ea70d-ed6f-4f99-ad65-83919268a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:35.880235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ea70d-ed6f-4f99-ad65-83919268a7c6 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:35.881550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 688/1392] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:35.887192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b286-554b-424e-a4e2-542052b338fb None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:35.887736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b286-554b-424e-a4e2-542052b338fb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:35.887736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238b286-554b-424e-a4e2-542052b338fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:35.907770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a238b286-554b-424e-a4e2-542052b338fb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:35.908925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a238b286-554b-424e-a4e2-542052b338fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:35.917313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 705/1393] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:35.962636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ea70d-ed6f-4f99-ad65-83919268a7c6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:35.977587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ea70d-ed6f-4f99-ad65-83919268a7c6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:35.983459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8e8ea-30fd-4bb1-8d9e-cb78a0aba135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:35.984110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e8ea-30fd-4bb1-8d9e-cb78a0aba135 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:35.984395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e8ea-30fd-4bb1-8d9e-cb78a0aba135 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:35.984678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8e8ea-30fd-4bb1-8d9e-cb78a0aba135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:35.993358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8e8ea-30fd-4bb1-8d9e-cb78a0aba135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:35.995015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8e8ea-30fd-4bb1-8d9e-cb78a0aba135 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:36.005308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 689/1394] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:37.253825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23de6-4b1b-4b6f-a5e0-d7bcfac0f203 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:37.254402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23de6-4b1b-4b6f-a5e0-d7bcfac0f203 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:37.254402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23de6-4b1b-4b6f-a5e0-d7bcfac0f203 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:37.255938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 706/1395] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:08:37.261526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331490a6-5657-4df8-adcf-5a26c1a1e9e3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:37.261983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331490a6-5657-4df8-adcf-5a26c1a1e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:37.262109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331490a6-5657-4df8-adcf-5a26c1a1e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:37.282273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-331490a6-5657-4df8-adcf-5a26c1a1e9e3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:37.283483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-331490a6-5657-4df8-adcf-5a26c1a1e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:37.293018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 690/1396] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:37.348766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d710-305b-4271-8770-a89e0e2f6c1a None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:37.349077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d710-305b-4271-8770-a89e0e2f6c1a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:37.349388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478d710-305b-4271-8770-a89e0e2f6c1a None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:37.350837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 707/1397] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jun 15 22:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:37.356175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2a3a-c36d-4aff-9b32-251312093742 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:37.356342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2a3a-c36d-4aff-9b32-251312093742 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:37.356648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb2a3a-c36d-4aff-9b32-251312093742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:37.409759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ccfb2a3a-c36d-4aff-9b32-251312093742 None None] MFA Rules not processed for user `d6a0960c6d4a497fbd2761d46689fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:37.410968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ccfb2a3a-c36d-4aff-9b32-251312093742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:37.477400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 691/1398] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jun 15 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:08:37.485678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478d710-305b-4271-8770-a89e0e2f6c1a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:37.497058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478d710-305b-4271-8770-a89e0e2f6c1a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:37.500894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cded3e-f09a-4a95-ae11-c469509f21b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:37.501594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cded3e-f09a-4a95-ae11-c469509f21b8 service glance] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:37.501881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cded3e-f09a-4a95-ae11-c469509f21b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:37.502158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cded3e-f09a-4a95-ae11-c469509f21b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:37.511861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cded3e-f09a-4a95-ae11-c469509f21b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:37.513312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cded3e-f09a-4a95-ae11-c469509f21b8 service glance] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:37.523352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 708/1399] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:38.200067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31053-e07b-4909-b6fd-362021eeed06 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.200356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31053-e07b-4909-b6fd-362021eeed06 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.200673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31053-e07b-4909-b6fd-362021eeed06 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.202082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 692/1400] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:38.207678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.207968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.208250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.227795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:38.229051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:38.241140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 709/1401] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:38.273885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a599e-30f6-472e-b036-29c84d2081e0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.274273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a599e-30f6-472e-b036-29c84d2081e0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.274273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a599e-30f6-472e-b036-29c84d2081e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.280493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:38.287135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:38.300874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219e89b-b912-4532-8916-9abc7ff2ab9d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:38.306599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81e7fc-cc7a-4034-b4cf-18a9bcd17c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:38.307493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e7fc-cc7a-4034-b4cf-18a9bcd17c7d service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.307965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e7fc-cc7a-4034-b4cf-18a9bcd17c7d service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.308247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81e7fc-cc7a-4034-b4cf-18a9bcd17c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.317355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81e7fc-cc7a-4034-b4cf-18a9bcd17c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:38.319751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81e7fc-cc7a-4034-b4cf-18a9bcd17c7d service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:38.329602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3b6a599e-30f6-472e-b036-29c84d2081e0 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:38.329798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 710/1402] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:38.330854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3b6a599e-30f6-472e-b036-29c84d2081e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:38.400330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 693/1403] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:38.446845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224dd98-704e-436d-9e81-2ac123408691 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.447332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224dd98-704e-436d-9e81-2ac123408691 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.447773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224dd98-704e-436d-9e81-2ac123408691 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.449952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 711/1404] 10.222.0.55 () {54 vars in 942 bytes} [Wed Jun 15 22:08:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:38.458217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36548d72-53e0-4a99-8378-3a057e3b41f0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.458800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36548d72-53e0-4a99-8378-3a057e3b41f0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.459237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36548d72-53e0-4a99-8378-3a057e3b41f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.522195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-36548d72-53e0-4a99-8378-3a057e3b41f0 None None] MFA Rules not processed for user `f433e4fc095b4c149082b305ea3c625d`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:38.523490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-36548d72-53e0-4a99-8378-3a057e3b41f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:38.606292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 694/1405] 10.222.0.55 () {58 vars in 1039 bytes} [Wed Jun 15 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:38.616092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224dd98-704e-436d-9e81-2ac123408691 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:38.631228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224dd98-704e-436d-9e81-2ac123408691 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:38.636867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1464856-9260-4d9d-ba8c-82ce57db5670 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:38.637558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1464856-9260-4d9d-ba8c-82ce57db5670 service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:38.637846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1464856-9260-4d9d-ba8c-82ce57db5670 service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:38.638120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1464856-9260-4d9d-ba8c-82ce57db5670 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:38.646957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1464856-9260-4d9d-ba8c-82ce57db5670 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:38.648554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1464856-9260-4d9d-ba8c-82ce57db5670 service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:38.658093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 712/1406] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:08:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:08:40.590878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f793d-2062-4d56-8c59-b43ed4e8bc11 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:40.591472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f793d-2062-4d56-8c59-b43ed4e8bc11 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:40.591472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f793d-2062-4d56-8c59-b43ed4e8bc11 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:40.592703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 695/1407] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:08:40.598149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317779-3e55-4e69-9d63-608910f6a212 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:40.598640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317779-3e55-4e69-9d63-608910f6a212 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:40.598747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5317779-3e55-4e69-9d63-608910f6a212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:40.617657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b5317779-3e55-4e69-9d63-608910f6a212 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:08:40.618859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b5317779-3e55-4e69-9d63-608910f6a212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:08:40.627976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 713/1408] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:08:40.674699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f793d-2062-4d56-8c59-b43ed4e8bc11 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:08:40.690287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f793d-2062-4d56-8c59-b43ed4e8bc11 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:08:40.696132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33836a-6185-45f3-a7a6-673c3249e4f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:08:40.696784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33836a-6185-45f3-a7a6-673c3249e4f9 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:08:40.697060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33836a-6185-45f3-a7a6-673c3249e4f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:08:40.697476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33836a-6185-45f3-a7a6-673c3249e4f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:08:40.709449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33836a-6185-45f3-a7a6-673c3249e4f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:08:40.711075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33836a-6185-45f3-a7a6-673c3249e4f9 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:08:40.721655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 696/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:08:50.612329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=46 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:08:50.716834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:01.424203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acafe-f609-4053-aed1-5486ca000cc1 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:01.424819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acafe-f609-4053-aed1-5486ca000cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:01.424819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acafe-f609-4053-aed1-5486ca000cc1 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:01.426242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 714/1410] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jun 15 22:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:01.431936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7263a-80d9-4bfd-b3c9-5fdf848f2b95 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:01.432505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7263a-80d9-4bfd-b3c9-5fdf848f2b95 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:01.432646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7263a-80d9-4bfd-b3c9-5fdf848f2b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:01.453507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5fa7263a-80d9-4bfd-b3c9-5fdf848f2b95 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:01.454747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5fa7263a-80d9-4bfd-b3c9-5fdf848f2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:01.465524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 697/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 15 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:01.483408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04fa88-0847-4a22-b912-798590b9f4ea None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:01.483730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04fa88-0847-4a22-b912-798590b9f4ea None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:01.484093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04fa88-0847-4a22-b912-798590b9f4ea None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:01.486005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 715/1412] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jun 15 22:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:01.491969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ed13d-6f73-488f-a65b-df3642f460f4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:01.492379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ed13d-6f73-488f-a65b-df3642f460f4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:01.492771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ed13d-6f73-488f-a65b-df3642f460f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:01.513980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b35ed13d-6f73-488f-a65b-df3642f460f4 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:01.515200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b35ed13d-6f73-488f-a65b-df3642f460f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:01.526440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 698/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jun 15 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:04.143449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43bff1-816d-4c38-b651-64e6258609be None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:04.144023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43bff1-816d-4c38-b651-64e6258609be None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:04.144023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43bff1-816d-4c38-b651-64e6258609be None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:04.145458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:04.151507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37186-0a70-4314-91f3-21cff13e300a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:04.151984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37186-0a70-4314-91f3-21cff13e300a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:04.152309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37186-0a70-4314-91f3-21cff13e300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:04.173441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dac37186-0a70-4314-91f3-21cff13e300a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:04.174651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dac37186-0a70-4314-91f3-21cff13e300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:04.183592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:04.227917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43bff1-816d-4c38-b651-64e6258609be None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:04.248876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43bff1-816d-4c38-b651-64e6258609be None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:04.257853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e46a-005c-4c33-b59c-d214f6b41f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:04.258512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e46a-005c-4c33-b59c-d214f6b41f7b service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:04.258792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e46a-005c-4c33-b59c-d214f6b41f7b service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:04.259057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e46a-005c-4c33-b59c-d214f6b41f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:04.269040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1e46a-005c-4c33-b59c-d214f6b41f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:04.270694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1e46a-005c-4c33-b59c-d214f6b41f7b service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:04.281207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 717/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:05.246927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba8245-6a5f-4d54-873e-ad8ded205d30 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:05.247414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba8245-6a5f-4d54-873e-ad8ded205d30 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:05.247530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba8245-6a5f-4d54-873e-ad8ded205d30 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:05.248875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:05.255066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce3527-ffe5-41d3-9069-11e514fc57d2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:05.255521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce3527-ffe5-41d3-9069-11e514fc57d2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:05.255617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce3527-ffe5-41d3-9069-11e514fc57d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:05.281426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d1ce3527-ffe5-41d3-9069-11e514fc57d2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:05.283007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d1ce3527-ffe5-41d3-9069-11e514fc57d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:05.292026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:05.442782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba8245-6a5f-4d54-873e-ad8ded205d30 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:05.461796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba8245-6a5f-4d54-873e-ad8ded205d30 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:05.470575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54c35d-e0f9-48a6-8e26-c30bec8a1cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:05.471231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c35d-e0f9-48a6-8e26-c30bec8a1cf5 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:05.471509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c35d-e0f9-48a6-8e26-c30bec8a1cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:05.471779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54c35d-e0f9-48a6-8e26-c30bec8a1cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:05.480825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c35d-e0f9-48a6-8e26-c30bec8a1cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:05.482446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54c35d-e0f9-48a6-8e26-c30bec8a1cf5 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:05.491971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 701/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:06.436468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319a62-15af-4400-9de7-1b0343ca7129 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:06.437195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319a62-15af-4400-9de7-1b0343ca7129 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:06.437195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58319a62-15af-4400-9de7-1b0343ca7129 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:06.439197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:06.446498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5f1-c9e2-4d98-a092-2db72c372223 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:06.446963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5f1-c9e2-4d98-a092-2db72c372223 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:06.447064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5f1-c9e2-4d98-a092-2db72c372223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:06.467126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4b50d5f1-c9e2-4d98-a092-2db72c372223 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:06.468607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4b50d5f1-c9e2-4d98-a092-2db72c372223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:06.478314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:06.639764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58319a62-15af-4400-9de7-1b0343ca7129 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:06.660786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58319a62-15af-4400-9de7-1b0343ca7129 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:06.667033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071056a2-0b87-49aa-b3c3-8496683c4f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:06.667687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071056a2-0b87-49aa-b3c3-8496683c4f76 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:06.667981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071056a2-0b87-49aa-b3c3-8496683c4f76 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:06.668259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071056a2-0b87-49aa-b3c3-8496683c4f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:06.676621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071056a2-0b87-49aa-b3c3-8496683c4f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:06.678565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071056a2-0b87-49aa-b3c3-8496683c4f76 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:06.692080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 720/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:07.608950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c8576-f67d-4f63-ac0a-d4737b7f58d5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:07.609888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c8576-f67d-4f63-ac0a-d4737b7f58d5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:07.609990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c8576-f67d-4f63-ac0a-d4737b7f58d5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:07.612226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:07.619828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7dfd-6060-4cad-a3ce-1b71f8eeaa59 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:07.620277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7dfd-6060-4cad-a3ce-1b71f8eeaa59 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:07.620399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7dfd-6060-4cad-a3ce-1b71f8eeaa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:07.639630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-2b1e7dfd-6060-4cad-a3ce-1b71f8eeaa59 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:07.640829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2b1e7dfd-6060-4cad-a3ce-1b71f8eeaa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:07.649959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:09:07.806818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c8576-f67d-4f63-ac0a-d4737b7f58d5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:07.824583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c8576-f67d-4f63-ac0a-d4737b7f58d5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:07.831633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3611-07d8-454a-9287-8261f4d4aa24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:07.832291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3611-07d8-454a-9287-8261f4d4aa24 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:07.832569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3611-07d8-454a-9287-8261f4d4aa24 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:07.832837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3611-07d8-454a-9287-8261f4d4aa24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:07.841891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3611-07d8-454a-9287-8261f4d4aa24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:07.843508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3611-07d8-454a-9287-8261f4d4aa24 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:07.853753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 704/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:08.785405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbf53-bbfa-4f9c-932d-177c6312a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:08.785978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbf53-bbfa-4f9c-932d-177c6312a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:08.785978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbbf53-bbfa-4f9c-932d-177c6312a8f0 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:08.788064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:08.793771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087492-1ceb-46c9-9718-86a219903a2d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:08.794191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087492-1ceb-46c9-9718-86a219903a2d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:08.794312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd087492-1ceb-46c9-9718-86a219903a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:08.813504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dd087492-1ceb-46c9-9718-86a219903a2d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:08.814786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dd087492-1ceb-46c9-9718-86a219903a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:08.824108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:08.978582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbf53-bbfa-4f9c-932d-177c6312a8f0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:08.995262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbbf53-bbfa-4f9c-932d-177c6312a8f0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:09.002461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bdcd8-9578-4458-8a08-31a8331630c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:09.003100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdcd8-9578-4458-8a08-31a8331630c8 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:09.003388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdcd8-9578-4458-8a08-31a8331630c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:09.003661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bdcd8-9578-4458-8a08-31a8331630c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:09.013813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdcd8-9578-4458-8a08-31a8331630c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:09.015415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bdcd8-9578-4458-8a08-31a8331630c8 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:09.025854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 723/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:09.894166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8a9c-e27b-44bb-8999-c684d8a00ff8 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:09.895053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8a9c-e27b-44bb-8999-c684d8a00ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:09.895053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8a9c-e27b-44bb-8999-c684d8a00ff8 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:09.897217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:09.902708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7da87d-cbaf-42cc-8215-a13f112a55b5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:09.903161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7da87d-cbaf-42cc-8215-a13f112a55b5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:09.903353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7da87d-cbaf-42cc-8215-a13f112a55b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:09.922606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ce7da87d-cbaf-42cc-8215-a13f112a55b5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:09.923828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ce7da87d-cbaf-42cc-8215-a13f112a55b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:09.933165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:10.086902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8a9c-e27b-44bb-8999-c684d8a00ff8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:10.106487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8a9c-e27b-44bb-8999-c684d8a00ff8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:10.113807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401b10a-8ec7-4310-a344-132910ced835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:10.114448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401b10a-8ec7-4310-a344-132910ced835 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:10.114719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401b10a-8ec7-4310-a344-132910ced835 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:10.114988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401b10a-8ec7-4310-a344-132910ced835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:10.126187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401b10a-8ec7-4310-a344-132910ced835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:10.127785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401b10a-8ec7-4310-a344-132910ced835 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:10.141767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 707/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:10.992795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea09a-4afa-4cd2-bc1b-ed044cac0495 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:10.993541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea09a-4afa-4cd2-bc1b-ed044cac0495 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:10.993541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea09a-4afa-4cd2-bc1b-ed044cac0495 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:10.994775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:11.000928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2397ec-fcc3-4198-af27-ff2fa89252b2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:11.001859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2397ec-fcc3-4198-af27-ff2fa89252b2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:11.001859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2397ec-fcc3-4198-af27-ff2fa89252b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:11.024419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1d2397ec-fcc3-4198-af27-ff2fa89252b2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:11.025684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1d2397ec-fcc3-4198-af27-ff2fa89252b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:11.034893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:11.190635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea09a-4afa-4cd2-bc1b-ed044cac0495 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:11.206564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea09a-4afa-4cd2-bc1b-ed044cac0495 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:11.213306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36361acd-eee2-4707-9dad-520ca9baf384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:11.214651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361acd-eee2-4707-9dad-520ca9baf384 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:11.214959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361acd-eee2-4707-9dad-520ca9baf384 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:11.215223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361acd-eee2-4707-9dad-520ca9baf384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:11.224260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36361acd-eee2-4707-9dad-520ca9baf384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:11.225913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36361acd-eee2-4707-9dad-520ca9baf384 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:11.238227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 726/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:12.112564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ed1c-70a4-48ad-946d-528b476cec27 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:12.113491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ed1c-70a4-48ad-946d-528b476cec27 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:12.113491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643ed1c-70a4-48ad-946d-528b476cec27 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:12.115638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:12.123270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94e53-8fb4-414c-91fa-f9f08132cc55 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:12.123786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94e53-8fb4-414c-91fa-f9f08132cc55 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:12.123786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94e53-8fb4-414c-91fa-f9f08132cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:12.151622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-32a94e53-8fb4-414c-91fa-f9f08132cc55 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:12.153044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-32a94e53-8fb4-414c-91fa-f9f08132cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:12.162148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:12.324882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643ed1c-70a4-48ad-946d-528b476cec27 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:12.347676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643ed1c-70a4-48ad-946d-528b476cec27 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:12.356282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7775392-a1bf-48e9-93f2-8e273890939c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:12.356947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775392-a1bf-48e9-93f2-8e273890939c service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:12.357219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775392-a1bf-48e9-93f2-8e273890939c service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:12.357537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775392-a1bf-48e9-93f2-8e273890939c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:12.366941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7775392-a1bf-48e9-93f2-8e273890939c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:12.368516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7775392-a1bf-48e9-93f2-8e273890939c service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:12.379013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 710/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:13.237056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976c89-a898-4145-936a-7cb1e3150437 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:13.237529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976c89-a898-4145-936a-7cb1e3150437 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:13.237529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976c89-a898-4145-936a-7cb1e3150437 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:13.239127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:13.245943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c995f-b297-4528-ad91-15a46cce3c2d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:13.246482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c995f-b297-4528-ad91-15a46cce3c2d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:13.246482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c995f-b297-4528-ad91-15a46cce3c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:13.265202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d18c995f-b297-4528-ad91-15a46cce3c2d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:13.266438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d18c995f-b297-4528-ad91-15a46cce3c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:13.275067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:13.429778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82976c89-a898-4145-936a-7cb1e3150437 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:13.453383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82976c89-a898-4145-936a-7cb1e3150437 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:13.463404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a125452-53fc-4cfa-a4fc-ae7e02324c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:13.464477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a125452-53fc-4cfa-a4fc-ae7e02324c8d service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:13.464617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a125452-53fc-4cfa-a4fc-ae7e02324c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:13.464860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a125452-53fc-4cfa-a4fc-ae7e02324c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:13.474482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a125452-53fc-4cfa-a4fc-ae7e02324c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:13.476102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a125452-53fc-4cfa-a4fc-ae7e02324c8d service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:13.486813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 729/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:15.529387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2836-0fd6-4bf1-918e-2f6c8f5f9a36 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:15.530282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2836-0fd6-4bf1-918e-2f6c8f5f9a36 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:15.530282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d2836-0fd6-4bf1-918e-2f6c8f5f9a36 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:15.532592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:15.541106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54fdc-390a-4d20-b08b-43ded3b8049b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:15.541629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54fdc-390a-4d20-b08b-43ded3b8049b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:15.541864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54fdc-390a-4d20-b08b-43ded3b8049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:15.561095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1bf54fdc-390a-4d20-b08b-43ded3b8049b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:15.562375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1bf54fdc-390a-4d20-b08b-43ded3b8049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:15.572117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:15.614740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d2836-0fd6-4bf1-918e-2f6c8f5f9a36 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:15.617778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c55d2836-0fd6-4bf1-918e-2f6c8f5f9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:15.634040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d2836-0fd6-4bf1-918e-2f6c8f5f9a36 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:15.638517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c1c79-7330-4c3d-9b9f-a74de338fe48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:15.639140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1c79-7330-4c3d-9b9f-a74de338fe48 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:15.639445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1c79-7330-4c3d-9b9f-a74de338fe48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:15.639718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c1c79-7330-4c3d-9b9f-a74de338fe48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:15.650285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c1c79-7330-4c3d-9b9f-a74de338fe48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:15.651987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c1c79-7330-4c3d-9b9f-a74de338fe48 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:15.662192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 713/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:18.160675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e525518-a48c-4c8c-8e21-3c55bf9cfc0c None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:18.161636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e525518-a48c-4c8c-8e21-3c55bf9cfc0c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:18.161636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e525518-a48c-4c8c-8e21-3c55bf9cfc0c None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:18.163916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:18.170616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee181fe-c846-4394-a70f-2ffd96095546 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:18.171333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee181fe-c846-4394-a70f-2ffd96095546 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:18.171424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee181fe-c846-4394-a70f-2ffd96095546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:18.194854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4ee181fe-c846-4394-a70f-2ffd96095546 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:18.196085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4ee181fe-c846-4394-a70f-2ffd96095546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:18.206323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:18.244937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e525518-a48c-4c8c-8e21-3c55bf9cfc0c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:18.263030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e525518-a48c-4c8c-8e21-3c55bf9cfc0c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:18.267392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55aa19-a089-4cad-813b-7b4bccfe766e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:18.268052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55aa19-a089-4cad-813b-7b4bccfe766e service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:18.268337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55aa19-a089-4cad-813b-7b4bccfe766e service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:18.268614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55aa19-a089-4cad-813b-7b4bccfe766e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:18.278953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55aa19-a089-4cad-813b-7b4bccfe766e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:18.280384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55aa19-a089-4cad-813b-7b4bccfe766e service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:18.290541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 732/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:20.997604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c81b3-2248-4d61-88a3-53bb296acfbc None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:20.998193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c81b3-2248-4d61-88a3-53bb296acfbc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:20.998193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c81b3-2248-4d61-88a3-53bb296acfbc None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:20.999610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:21.005310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c76f-0318-4b9a-b9ad-f5b130bce0d3 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:21.005771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c76f-0318-4b9a-b9ad-f5b130bce0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:21.005883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c76f-0318-4b9a-b9ad-f5b130bce0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:21.027100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0198c76f-0318-4b9a-b9ad-f5b130bce0d3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:21.028316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0198c76f-0318-4b9a-b9ad-f5b130bce0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:21.036992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:21.079170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c81b3-2248-4d61-88a3-53bb296acfbc None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:21.094368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c81b3-2248-4d61-88a3-53bb296acfbc None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:21.098405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43222e5f-b55c-4d19-9058-859a010180e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:21.099053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222e5f-b55c-4d19-9058-859a010180e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:21.099332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222e5f-b55c-4d19-9058-859a010180e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:21.099605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43222e5f-b55c-4d19-9058-859a010180e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:21.110132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222e5f-b55c-4d19-9058-859a010180e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:21.111575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43222e5f-b55c-4d19-9058-859a010180e6 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:21.122420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 716/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:23.426233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e03f3-b014-47da-85b1-1f75d8cf0b8a None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:23.426821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e03f3-b014-47da-85b1-1f75d8cf0b8a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:23.426821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e03f3-b014-47da-85b1-1f75d8cf0b8a None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:23.428187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:23.435183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4009-5722-40c4-aa05-ca788750ea73 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:23.436039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4009-5722-40c4-aa05-ca788750ea73 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:23.436039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4009-5722-40c4-aa05-ca788750ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:23.459453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-252c4009-5722-40c4-aa05-ca788750ea73 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:23.461361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-252c4009-5722-40c4-aa05-ca788750ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:23.471581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:23.513310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e03f3-b014-47da-85b1-1f75d8cf0b8a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:23.528704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e03f3-b014-47da-85b1-1f75d8cf0b8a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:23.536236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e092586-731c-4632-9054-4593f093d786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:23.537176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e092586-731c-4632-9054-4593f093d786 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:23.537478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e092586-731c-4632-9054-4593f093d786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:23.537816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e092586-731c-4632-9054-4593f093d786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:23.549903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e092586-731c-4632-9054-4593f093d786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:23.551347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e092586-731c-4632-9054-4593f093d786 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:23.561885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 735/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:25.809290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24168476-c167-40a0-a046-968f1445902b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:25.809951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24168476-c167-40a0-a046-968f1445902b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:25.809951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24168476-c167-40a0-a046-968f1445902b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:25.811276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:25.816819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe69623-7d64-457d-bd44-6a1f2a6e7cd5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:25.817269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe69623-7d64-457d-bd44-6a1f2a6e7cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:25.817406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe69623-7d64-457d-bd44-6a1f2a6e7cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:25.837259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cbe69623-7d64-457d-bd44-6a1f2a6e7cd5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:25.838481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cbe69623-7d64-457d-bd44-6a1f2a6e7cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:25.847438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:25.886798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24168476-c167-40a0-a046-968f1445902b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:25.903427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24168476-c167-40a0-a046-968f1445902b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:25.910369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293792c8-936e-4096-aea3-40121fe43e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:25.911325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293792c8-936e-4096-aea3-40121fe43e3f service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:25.911622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293792c8-936e-4096-aea3-40121fe43e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:25.911944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293792c8-936e-4096-aea3-40121fe43e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:25.924058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293792c8-936e-4096-aea3-40121fe43e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:25.925575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293792c8-936e-4096-aea3-40121fe43e3f service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:25.935500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 719/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:09:28.149907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a15ed-7ccb-42c8-89ae-5ba6ffe77d68 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:28.150815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a15ed-7ccb-42c8-89ae-5ba6ffe77d68 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:28.150815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a15ed-7ccb-42c8-89ae-5ba6ffe77d68 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:28.153239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:28.162851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60ae3-214a-420c-8ca2-f3c1c9b3cf0a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:28.163646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60ae3-214a-420c-8ca2-f3c1c9b3cf0a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:28.163799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb60ae3-214a-420c-8ca2-f3c1c9b3cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:28.185669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ffb60ae3-214a-420c-8ca2-f3c1c9b3cf0a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:28.186890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ffb60ae3-214a-420c-8ca2-f3c1c9b3cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:28.196193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:28.236891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a15ed-7ccb-42c8-89ae-5ba6ffe77d68 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:28.250093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a15ed-7ccb-42c8-89ae-5ba6ffe77d68 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:28.254258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3f9fd-e95a-4106-9402-561e3e330eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:28.254934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3f9fd-e95a-4106-9402-561e3e330eac service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:28.255331 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3f9fd-e95a-4106-9402-561e3e330eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:28.255500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3f9fd-e95a-4106-9402-561e3e330eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:28.266439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3f9fd-e95a-4106-9402-561e3e330eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:28.267901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3f9fd-e95a-4106-9402-561e3e330eac service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:28.278280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 738/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:30.630762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819712-2dc3-42aa-9c32-5487071c2d56 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:30.631459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819712-2dc3-42aa-9c32-5487071c2d56 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:30.631459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80819712-2dc3-42aa-9c32-5487071c2d56 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:30.633306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:30.642192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36570e-9ea4-4507-af48-755e2a0f2b85 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:30.643177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36570e-9ea4-4507-af48-755e2a0f2b85 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:30.643177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36570e-9ea4-4507-af48-755e2a0f2b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:30.653293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=70 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:30.668240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-bc36570e-9ea4-4507-af48-755e2a0f2b85 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:30.669498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-bc36570e-9ea4-4507-af48-755e2a0f2b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:30.678699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:30.721388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819712-2dc3-42aa-9c32-5487071c2d56 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:30.731070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=73 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:30.740786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80819712-2dc3-42aa-9c32-5487071c2d56 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:30.746894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d77ef5-ebc2-4c40-87d4-049fa6303658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:30.747535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d77ef5-ebc2-4c40-87d4-049fa6303658 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:30.747815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d77ef5-ebc2-4c40-87d4-049fa6303658 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:30.748090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d77ef5-ebc2-4c40-87d4-049fa6303658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:30.757372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d77ef5-ebc2-4c40-87d4-049fa6303658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:30.758812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d77ef5-ebc2-4c40-87d4-049fa6303658 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:30.768226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 722/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:33.017016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c1f8-30dd-4981-a5fe-4d7aa430c460 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:33.017639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c1f8-30dd-4981-a5fe-4d7aa430c460 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:33.017639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753c1f8-30dd-4981-a5fe-4d7aa430c460 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:33.019078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:33.024717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ba44-93aa-4733-8c3f-71315b3e247a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:33.025182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ba44-93aa-4733-8c3f-71315b3e247a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:33.025286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070ba44-93aa-4733-8c3f-71315b3e247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:33.045063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6070ba44-93aa-4733-8c3f-71315b3e247a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:33.046306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6070ba44-93aa-4733-8c3f-71315b3e247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:33.055399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:33.095301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753c1f8-30dd-4981-a5fe-4d7aa430c460 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:33.113144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753c1f8-30dd-4981-a5fe-4d7aa430c460 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:33.119487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db303d-b03b-4ea7-8c4f-41319fa948ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:33.120648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db303d-b03b-4ea7-8c4f-41319fa948ac service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:33.120937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db303d-b03b-4ea7-8c4f-41319fa948ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:33.121217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db303d-b03b-4ea7-8c4f-41319fa948ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:33.132485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db303d-b03b-4ea7-8c4f-41319fa948ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:33.135010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db303d-b03b-4ea7-8c4f-41319fa948ac service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:33.148115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 741/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:35.355849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62b6f6-7ad9-4fc3-8d14-fefa059c16c5 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:35.357005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62b6f6-7ad9-4fc3-8d14-fefa059c16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:35.357005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62b6f6-7ad9-4fc3-8d14-fefa059c16c5 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:35.358833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:35.366307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8eda-ad97-4882-a35a-cce89fa3f98c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:35.366808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8eda-ad97-4882-a35a-cce89fa3f98c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:35.366928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d8eda-ad97-4882-a35a-cce89fa3f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:35.387228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-482d8eda-ad97-4882-a35a-cce89fa3f98c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:35.388454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-482d8eda-ad97-4882-a35a-cce89fa3f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:35.397337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:09:35.434667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62b6f6-7ad9-4fc3-8d14-fefa059c16c5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:35.447300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62b6f6-7ad9-4fc3-8d14-fefa059c16c5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:35.451023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050929fe-dd75-49cc-a8d8-48e6e0dcd12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:35.451681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050929fe-dd75-49cc-a8d8-48e6e0dcd12c service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:35.451966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050929fe-dd75-49cc-a8d8-48e6e0dcd12c service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:35.452241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050929fe-dd75-49cc-a8d8-48e6e0dcd12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:35.462469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050929fe-dd75-49cc-a8d8-48e6e0dcd12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:35.463909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050929fe-dd75-49cc-a8d8-48e6e0dcd12c service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:35.474838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 725/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:37.664664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9e4f-5c28-4416-bcf5-5cb1ef72fcfe None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:37.665221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9e4f-5c28-4416-bcf5-5cb1ef72fcfe None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:37.665317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9e4f-5c28-4416-bcf5-5cb1ef72fcfe None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:37.667495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:37.676733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99146d06-c0b8-4c79-9a50-bd72c23a6e58 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:37.677535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99146d06-c0b8-4c79-9a50-bd72c23a6e58 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:37.677712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99146d06-c0b8-4c79-9a50-bd72c23a6e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:37.700791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-99146d06-c0b8-4c79-9a50-bd72c23a6e58 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:37.702044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-99146d06-c0b8-4c79-9a50-bd72c23a6e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:37.711658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:37.749045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9e4f-5c28-4416-bcf5-5cb1ef72fcfe None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:37.761073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9e4f-5c28-4416-bcf5-5cb1ef72fcfe None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:37.765369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8ee3b-c73f-4efb-81f5-d6ec873ada6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:37.766008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ee3b-c73f-4efb-81f5-d6ec873ada6e service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:37.766292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ee3b-c73f-4efb-81f5-d6ec873ada6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:37.766570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ee3b-c73f-4efb-81f5-d6ec873ada6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:37.780470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8ee3b-c73f-4efb-81f5-d6ec873ada6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:37.782992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8ee3b-c73f-4efb-81f5-d6ec873ada6e service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:37.796636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 744/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:09:47.695012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=17 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:47.790928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=17 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:09:58.000550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c816c0-5339-40c9-b94f-d83153c65c72 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:58.001453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c816c0-5339-40c9-b94f-d83153c65c72 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:58.001453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c816c0-5339-40c9-b94f-d83153c65c72 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:58.003742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 727/1471] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:09:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:58.010427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9078454-1459-49c3-bbed-220bfcd53217 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:58.010886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9078454-1459-49c3-bbed-220bfcd53217 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:58.010990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9078454-1459-49c3-bbed-220bfcd53217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:58.032195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f9078454-1459-49c3-bbed-220bfcd53217 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:58.033818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f9078454-1459-49c3-bbed-220bfcd53217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:58.043115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 745/1472] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:58.091252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766215c-9381-4950-9598-91aee53cc1b3 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:58.091541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766215c-9381-4950-9598-91aee53cc1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:58.091817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766215c-9381-4950-9598-91aee53cc1b3 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:58.093472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 728/1473] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jun 15 22:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:09:58.099265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f180043-965c-4d9f-84ca-d1af36ce8283 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:58.099578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f180043-965c-4d9f-84ca-d1af36ce8283 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:58.099849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f180043-965c-4d9f-84ca-d1af36ce8283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:58.122884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5f180043-965c-4d9f-84ca-d1af36ce8283 None None] MFA Rules not processed for user `d6a0960c6d4a497fbd2761d46689fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:09:58.124272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5f180043-965c-4d9f-84ca-d1af36ce8283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:09:58.132123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 746/1474] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jun 15 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:09:58.139725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766215c-9381-4950-9598-91aee53cc1b3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:09:58.152621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766215c-9381-4950-9598-91aee53cc1b3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:09:58.156911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cd71b-ef42-4795-8577-5b2cb919247a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:09:58.157987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd71b-ef42-4795-8577-5b2cb919247a service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:09:58.158266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd71b-ef42-4795-8577-5b2cb919247a service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:09:58.158540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cd71b-ef42-4795-8577-5b2cb919247a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:09:58.168750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cd71b-ef42-4795-8577-5b2cb919247a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:09:58.170453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cd71b-ef42-4795-8577-5b2cb919247a service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:09:58.180027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 729/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:10:00.426470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4c0f1-fa94-48a5-93e9-16292cd1f3a3 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:00.427328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4c0f1-fa94-48a5-93e9-16292cd1f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:00.427328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4c0f1-fa94-48a5-93e9-16292cd1f3a3 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:00.429314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 747/1476] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:10:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:10:00.435625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6222-d621-4540-b755-72cc224c84f3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:00.436399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6222-d621-4540-b755-72cc224c84f3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:00.436893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6222-d621-4540-b755-72cc224c84f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:00.461305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ebde6222-d621-4540-b755-72cc224c84f3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:10:00.462533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ebde6222-d621-4540-b755-72cc224c84f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:10:00.471073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 730/1477] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:10:00.494844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4c0f1-fa94-48a5-93e9-16292cd1f3a3 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:10:00.508785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4c0f1-fa94-48a5-93e9-16292cd1f3a3 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:10:00.514806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:10:00.515478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:00.515761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:00.516032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:00.516769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:10:00.518662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:10:00.518662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:10:00.518662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:10:00.519829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923b083-d914-4f91-9d54-f885a2c4965b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:10:00.540602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 748/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jun 15 22:10:00 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:10:02.694114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9449-6201-4f8e-b1fa-3a48a88834cc None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:02.695019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9449-6201-4f8e-b1fa-3a48a88834cc None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:02.695019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da9449-6201-4f8e-b1fa-3a48a88834cc None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:02.697241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 731/1479] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:10:02.703399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3ec99-01b1-4a30-b438-c3df9479827a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:02.704103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3ec99-01b1-4a30-b438-c3df9479827a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:02.704274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3ec99-01b1-4a30-b438-c3df9479827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:02.734048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6db3ec99-01b1-4a30-b438-c3df9479827a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:10:02.735258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6db3ec99-01b1-4a30-b438-c3df9479827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:10:02.744861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 749/1480] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:10:02.793397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da9449-6201-4f8e-b1fa-3a48a88834cc None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:10:02.810140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da9449-6201-4f8e-b1fa-3a48a88834cc None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:10:02.816054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4eb9-53e4-4b9f-9422-a6694f38cc91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:10:02.816780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4eb9-53e4-4b9f-9422-a6694f38cc91 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:02.816998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4eb9-53e4-4b9f-9422-a6694f38cc91 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:02.817343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4eb9-53e4-4b9f-9422-a6694f38cc91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:02.826532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4eb9-53e4-4b9f-9422-a6694f38cc91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:10:02.828259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4eb9-53e4-4b9f-9422-a6694f38cc91 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:10:02.838383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 732/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:10:05.241869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5395a7-2b26-4e67-b6df-40e23b6d21c7 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:05.242693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5395a7-2b26-4e67-b6df-40e23b6d21c7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:05.242845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5395a7-2b26-4e67-b6df-40e23b6d21c7 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:05.244949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 750/1482] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:10:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:10:05.252642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2d77-91f3-4fea-a705-3f44a47ce01b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:05.253105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2d77-91f3-4fea-a705-3f44a47ce01b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:05.253221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d2d77-91f3-4fea-a705-3f44a47ce01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:05.272829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ca1d2d77-91f3-4fea-a705-3f44a47ce01b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:10:05.274138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ca1d2d77-91f3-4fea-a705-3f44a47ce01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:10:05.285962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 733/1483] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:10:05.335317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5395a7-2b26-4e67-b6df-40e23b6d21c7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:10:05.350475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5395a7-2b26-4e67-b6df-40e23b6d21c7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:10:05.354918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f325d9-1993-4cfb-83a9-902c19ebd183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:10:05.355542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f325d9-1993-4cfb-83a9-902c19ebd183 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:05.355818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f325d9-1993-4cfb-83a9-902c19ebd183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:05.356091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f325d9-1993-4cfb-83a9-902c19ebd183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:05.366661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f325d9-1993-4cfb-83a9-902c19ebd183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:10:05.368099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f325d9-1993-4cfb-83a9-902c19ebd183 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:10:05.378386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 751/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:10:07.564416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62bb6-dcc7-4501-95b1-2365e822e27e None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:07.564981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62bb6-dcc7-4501-95b1-2365e822e27e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:07.564981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62bb6-dcc7-4501-95b1-2365e822e27e None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:07.566308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 734/1485] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:10:07.572748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008310c-bc19-4624-815e-2af8e251b9ee None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:07.573224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008310c-bc19-4624-815e-2af8e251b9ee None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:07.573364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008310c-bc19-4624-815e-2af8e251b9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:07.601302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5008310c-bc19-4624-815e-2af8e251b9ee None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:10:07.602544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5008310c-bc19-4624-815e-2af8e251b9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:10:07.613090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 752/1486] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:10:07.656559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62bb6-dcc7-4501-95b1-2365e822e27e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:10:07.670437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62bb6-dcc7-4501-95b1-2365e822e27e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:10:07.674488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea49f1-7b92-46bc-bdee-412691363ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:10:07.675135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea49f1-7b92-46bc-bdee-412691363ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:07.675420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea49f1-7b92-46bc-bdee-412691363ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:07.675694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea49f1-7b92-46bc-bdee-412691363ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:07.685518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea49f1-7b92-46bc-bdee-412691363ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:10:07.686993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea49f1-7b92-46bc-bdee-412691363ce8 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:10:07.697069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 735/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:10:09.993664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ff727-027f-4af4-afb0-872baddbb383 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:09.994235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ff727-027f-4af4-afb0-872baddbb383 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:09.994235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ff727-027f-4af4-afb0-872baddbb383 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:09.995618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 753/1488] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:10:10.002065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f947b-f7cc-4811-94b1-72223538c6ee None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:10.002537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f947b-f7cc-4811-94b1-72223538c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:10.002659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f947b-f7cc-4811-94b1-72223538c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:10.028021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-af3f947b-f7cc-4811-94b1-72223538c6ee None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:10:10.029224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-af3f947b-f7cc-4811-94b1-72223538c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:10:10.038968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 736/1489] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:10:10.083608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ff727-027f-4af4-afb0-872baddbb383 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:10:10.102797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ff727-027f-4af4-afb0-872baddbb383 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:10:10.109483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a11ae5-3e8a-4762-9b9a-49f675dfac23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:10:10.110215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11ae5-3e8a-4762-9b9a-49f675dfac23 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:10.110477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11ae5-3e8a-4762-9b9a-49f675dfac23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:10.110761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a11ae5-3e8a-4762-9b9a-49f675dfac23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:10.120606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11ae5-3e8a-4762-9b9a-49f675dfac23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:10:10.122093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a11ae5-3e8a-4762-9b9a-49f675dfac23 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:10:10.132600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 754/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:10:12.434498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e036e-5cc5-4177-9cd5-ff160313c07d None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:12.435118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e036e-5cc5-4177-9cd5-ff160313c07d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:12.435118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e036e-5cc5-4177-9cd5-ff160313c07d None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:12.436473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 737/1491] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jun 15 22:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:10:12.442268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239146-399d-4881-8e92-93687155fa26 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:12.443222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239146-399d-4881-8e92-93687155fa26 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:12.443516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239146-399d-4881-8e92-93687155fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:12.465489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4f239146-399d-4881-8e92-93687155fa26 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:10:12.466788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4f239146-399d-4881-8e92-93687155fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:10:12.477909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 755/1492] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jun 15 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:10:12.520786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e036e-5cc5-4177-9cd5-ff160313c07d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:10:12.534314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e036e-5cc5-4177-9cd5-ff160313c07d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:10:12.538554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80070a2b-5dd2-4b0d-9146-f2ba25d67c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:10:12.539366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80070a2b-5dd2-4b0d-9146-f2ba25d67c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:10:12.539480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80070a2b-5dd2-4b0d-9146-f2ba25d67c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:10:12.539750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80070a2b-5dd2-4b0d-9146-f2ba25d67c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:10:12.553819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80070a2b-5dd2-4b0d-9146-f2ba25d67c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:10:12.555187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80070a2b-5dd2-4b0d-9146-f2ba25d67c81 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:10:12.568142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 738/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:10:22.459918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=33 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:10:22.562444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=33 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:11:39.206812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.207607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.207607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.227605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:11:39.228832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:39.239448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 756/1494] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:11:39.248975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.249629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.249629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.268710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:11:39.270152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:39.278925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 739/1495] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:11:39.284477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.294970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa94ed-b370-4948-9230-580588f2ed2e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.300018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.300721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.301037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.301396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.302141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:11:39.302448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.303490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:39.303490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:11:39.303490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:11:39.304404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.316818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 757/1496] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:11:39.325807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.336197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745adf7-2516-44a0-ad77-81fcecb3f264 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.340813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.341525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.341821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.342068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.342795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.344639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:39.344639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:11:39.344639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:11:39.345868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.389744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 740/1497] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:11:39 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:11:39.394324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.405221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c0cbb-71c9-48a3-aab6-50d895772bbf admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.467272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.467904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.468188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.468464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.469196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.470252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:39.470252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:11:39.470252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:11:39.471475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.492325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 758/1498] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:11:39 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:11:39.497040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.508285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fb027-bc91-446e-84ec-cfbb9b3887a6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.513913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.514605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.514890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.515165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.515899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.516926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:39.516926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:11:39.516926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:11:39.517842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.533109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 741/1499] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:11:39.538345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.548935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ed852-2684-4db6-a829-bdeddc6c3c59 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.554223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.554918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.555208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.555495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.556242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.557310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:39.557310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:11:39.557310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:11:39.558234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e946b-de97-4858-ae41-89eb105ffa63 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.574070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 759/1500] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:11:39.578926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.589941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fac43-5996-48fd-b6f3-64259e851e57 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.595175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.596096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.596391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.596669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] PATH_INFO: `/v3/projects/41441c191b824af5ab6814be7796d20f/users/7a869c1007a343af98be28a61cf2756a/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.613523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41441c191b824af5ab6814be7796d20f, user_id=7a869c1007a343af98be28a61cf2756a, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.614680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:39.614680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:11:39.614680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:11:39.616615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0227a-4a28-4b7c-a2ba-cacf1bda8b03 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.636993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 742/1501] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:11:39 2022] PUT /identity/v3/projects/41441c191b824af5ab6814be7796d20f/users/7a869c1007a343af98be28a61cf2756a/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:11:39.649887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0f9a-7cd7-49f4-9aea-4dbcc67edad3 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.650179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0f9a-7cd7-49f4-9aea-4dbcc67edad3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.650460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff0f9a-7cd7-49f4-9aea-4dbcc67edad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.680514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-aeff0f9a-7cd7-49f4-9aea-4dbcc67edad3 None None] MFA Rules not processed for user `7a869c1007a343af98be28a61cf2756a`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:11:39.681790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aeff0f9a-7cd7-49f4-9aea-4dbcc67edad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:39.752099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 760/1502] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:11:39.766099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776b3e-280a-4671-9eaf-5a3d7adff985 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.766368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776b3e-280a-4671-9eaf-5a3d7adff985 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.766659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776b3e-280a-4671-9eaf-5a3d7adff985 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.768060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 743/1503] 10.222.0.55 () {54 vars in 963 bytes} [Wed Jun 15 22:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:11:39.773466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f93a3f-931e-475e-bd38-dc05b496e0a2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.773836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f93a3f-931e-475e-bd38-dc05b496e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.774212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f93a3f-931e-475e-bd38-dc05b496e0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.793551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-64f93a3f-931e-475e-bd38-dc05b496e0a2 None None] MFA Rules not processed for user `85cfb11b9f0e4b0eb5078ab7a14948ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:11:39.794784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-64f93a3f-931e-475e-bd38-dc05b496e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:39.841108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:11:39.851140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 761/1504] 10.222.0.55 () {58 vars in 1060 bytes} [Wed Jun 15 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:11:39.859593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776b3e-280a-4671-9eaf-5a3d7adff985 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:39.872058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776b3e-280a-4671-9eaf-5a3d7adff985 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:39.875705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:39.876360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.876638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.876913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.885898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:39.887333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:39.896849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 744/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:11:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:11:39.940255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e72cdf-a651-4a55-898d-2c58ff9cffb4 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:39.940547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e72cdf-a651-4a55-898d-2c58ff9cffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:39.940821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e72cdf-a651-4a55-898d-2c58ff9cffb4 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:39.942241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 762/1506] 10.222.0.55 () {52 vars in 829 bytes} [Wed Jun 15 22:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:11:39.946291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:40.012513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c936b-fbb1-4fcb-9c40-32a2eb135918 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:40.017504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:40.018396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:40.018671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:40.018946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] PATH_INFO: `/v3/users/7a869c1007a343af98be28a61cf2756a` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:40.020312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a869c1007a343af98be28a61cf2756a)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:40.021368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:40.021368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:11:40.021368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:11:40.022558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:40.091526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a869c1007a343af98be28a61cf2756a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.103575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a869c1007a343af98be28a61cf2756a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.116877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a869c1007a343af98be28a61cf2756a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.117713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a869c1007a343af98be28a61cf2756a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.135325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:11:40.138549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a869c1007a343af98be28a61cf2756a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.146150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 745/1507] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:11:39 2022] DELETE /identity/v3/users/7a869c1007a343af98be28a61cf2756a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:11:40.151990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:40.152482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:40.152971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:40.176244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:11:40.177507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:40.245523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 763/1508] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:11:40.256853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:40.258723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:40.322407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571e87f-0429-4c51-a32b-ec51ec5ddcb1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:40.326279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142ffae-67a4-4278-a157-5d3daf4c5776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:40.326949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ffae-67a4-4278-a157-5d3daf4c5776 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:40.327234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ffae-67a4-4278-a157-5d3daf4c5776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:40.327511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142ffae-67a4-4278-a157-5d3daf4c5776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:40.338043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ffae-67a4-4278-a157-5d3daf4c5776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:40.339505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142ffae-67a4-4278-a157-5d3daf4c5776 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:40.350116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 746/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:11:40.742731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:11:40.744293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:11:40.756681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b7ca7-192a-4497-901f-a10248af4a86 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:11:40.761925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:11:40.762840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:11:40.763113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:11:40.764066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] PATH_INFO: `/v3/projects/41441c191b824af5ab6814be7796d20f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:11:40.766253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=41441c191b824af5ab6814be7796d20f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:11:40.767332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:11:40.767332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:11:40.767332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:11:40.768699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:11:40.840798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41441c191b824af5ab6814be7796d20f', 'request_id': 'req-da6c5709-0138-40eb-acba-7da680a2b42b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.848431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41441c191b824af5ab6814be7796d20f', 'request_id': 'req-da6c5709-0138-40eb-acba-7da680a2b42b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.863602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41441c191b824af5ab6814be7796d20f', 'request_id': 'req-da6c5709-0138-40eb-acba-7da680a2b42b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.880749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] The token cache is being invalidate because project 41441c191b824af5ab6814be7796d20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:11:40.881084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.881874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-da6c5709-0138-40eb-acba-7da680a2b42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:11:40.883468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 764/1510] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:11:40 2022] DELETE /identity/v3/projects/41441c191b824af5ab6814be7796d20f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:11:50.345241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:11:50.877574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:20.870451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770353-0316-45d8-984f-3258e148c21c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:20.871267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770353-0316-45d8-984f-3258e148c21c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:20.871267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770353-0316-45d8-984f-3258e148c21c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:20.872438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:20.878044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b590c24-5f62-4e67-b038-dd77ad619065 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:20.878724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b590c24-5f62-4e67-b038-dd77ad619065 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:20.878724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b590c24-5f62-4e67-b038-dd77ad619065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:20.900846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1b590c24-5f62-4e67-b038-dd77ad619065 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:20.902163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1b590c24-5f62-4e67-b038-dd77ad619065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:20.973455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:21.163041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770353-0316-45d8-984f-3258e148c21c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:21.166238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c0770353-0316-45d8-984f-3258e148c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:21.291505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770353-0316-45d8-984f-3258e148c21c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:21.298558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f7543-75b0-45f8-8044-a80dd4756126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:21.299493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7543-75b0-45f8-8044-a80dd4756126 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:21.299810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7543-75b0-45f8-8044-a80dd4756126 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:21.300162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7543-75b0-45f8-8044-a80dd4756126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:21.317301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f7543-75b0-45f8-8044-a80dd4756126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:21.320245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f7543-75b0-45f8-8044-a80dd4756126 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:21.335704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 748/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:22.308717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811bb81-9bb6-489a-806f-6013b4bc5928 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:22.309408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811bb81-9bb6-489a-806f-6013b4bc5928 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:22.309586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811bb81-9bb6-489a-806f-6013b4bc5928 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:22.311267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:13:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:22.317699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:22.318468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:22.318468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:22.329137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c61cc-6c5c-4206-b04a-21964b366fc1 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:22.329687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c61cc-6c5c-4206-b04a-21964b366fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:22.330030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c61cc-6c5c-4206-b04a-21964b366fc1 None None] PATH_INFO: `/v3` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:22.331584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 767/1515] 10.222.0.26 () {54 vars in 925 bytes} [Wed Jun 15 22:13:22 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:13:22.338362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e503-1a8e-4e7b-9e2f-0cbc5e79afc5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:22.338669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e503-1a8e-4e7b-9e2f-0cbc5e79afc5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:22.338905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6e503-1a8e-4e7b-9e2f-0cbc5e79afc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:22.342746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:22.344051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:22.355661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 749/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:22.366724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6ef6e503-1a8e-4e7b-9e2f-0cbc5e79afc5 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:22.368191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6ef6e503-1a8e-4e7b-9e2f-0cbc5e79afc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:22.447422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 768/1517] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Jun 15 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:13:22.518967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:22.532897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac7abc-5f3f-4cdd-9737-1a6bb3639bb2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:22.540348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dad7f-eaa7-482e-8e7e-b22da0713bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:22.541184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dad7f-eaa7-482e-8e7e-b22da0713bd7 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:22.541546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dad7f-eaa7-482e-8e7e-b22da0713bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:22.541946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dad7f-eaa7-482e-8e7e-b22da0713bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:22.553013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dad7f-eaa7-482e-8e7e-b22da0713bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:22.554801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dad7f-eaa7-482e-8e7e-b22da0713bd7 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:22.566327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 750/1518] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:31.369086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1727e-0a08-4679-ae2a-1c4ac25bb814 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:31.370046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1727e-0a08-4679-ae2a-1c4ac25bb814 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:31.370046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d1727e-0a08-4679-ae2a-1c4ac25bb814 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:31.371689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 769/1519] 10.222.0.55 () {54 vars in 960 bytes} [Wed Jun 15 22:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:31.377830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3507ff-70a3-41ee-84b8-04eddff26281 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:31.378457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3507ff-70a3-41ee-84b8-04eddff26281 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:31.378457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3507ff-70a3-41ee-84b8-04eddff26281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:31.399994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-cb3507ff-70a3-41ee-84b8-04eddff26281 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:31.401272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cb3507ff-70a3-41ee-84b8-04eddff26281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:31.411509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 751/1520] 10.222.0.55 () {58 vars in 1057 bytes} [Wed Jun 15 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:31.419794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1727e-0a08-4679-ae2a-1c4ac25bb814 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:31.434939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d1727e-0a08-4679-ae2a-1c4ac25bb814 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:31.440889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4750e-cdb1-4b8d-9c8f-c3088a3ef6d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:31.441604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4750e-cdb1-4b8d-9c8f-c3088a3ef6d9 service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:31.441889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4750e-cdb1-4b8d-9c8f-c3088a3ef6d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:31.442194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4750e-cdb1-4b8d-9c8f-c3088a3ef6d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:31.452304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4750e-cdb1-4b8d-9c8f-c3088a3ef6d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:31.454018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4750e-cdb1-4b8d-9c8f-c3088a3ef6d9 service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:31.465676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 770/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:33.923255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cbe5-918a-46c7-93e8-669dd62b43d7 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:33.923867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cbe5-918a-46c7-93e8-669dd62b43d7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:33.923867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6cbe5-918a-46c7-93e8-669dd62b43d7 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:33.925243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:33.931435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21306-16c7-490d-93aa-0f3c92b0731f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:33.932321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21306-16c7-490d-93aa-0f3c92b0731f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:33.932321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe21306-16c7-490d-93aa-0f3c92b0731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:33.951338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-efe21306-16c7-490d-93aa-0f3c92b0731f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:33.952648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-efe21306-16c7-490d-93aa-0f3c92b0731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:33.961921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:34.136413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6cbe5-918a-46c7-93e8-669dd62b43d7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:34.162383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6cbe5-918a-46c7-93e8-669dd62b43d7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:34.169940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e0dcf-5516-497f-bf2b-7cbe9e021a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:34.170621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e0dcf-5516-497f-bf2b-7cbe9e021a2f service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:34.170900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e0dcf-5516-497f-bf2b-7cbe9e021a2f service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:34.171171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e0dcf-5516-497f-bf2b-7cbe9e021a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:34.184470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e0dcf-5516-497f-bf2b-7cbe9e021a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:34.187008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e0dcf-5516-497f-bf2b-7cbe9e021a2f service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:34.200191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 753/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:35.126920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de211d1d-701c-4743-b687-68bda0eed95a None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:35.127491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de211d1d-701c-4743-b687-68bda0eed95a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:35.127491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de211d1d-701c-4743-b687-68bda0eed95a None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:35.129493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 22:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:35.135124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb87fb7-3d90-4cf8-ae1a-173d49da8f56 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:35.135688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb87fb7-3d90-4cf8-ae1a-173d49da8f56 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:35.135688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb87fb7-3d90-4cf8-ae1a-173d49da8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:35.155290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8bb87fb7-3d90-4cf8-ae1a-173d49da8f56 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:35.156552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8bb87fb7-3d90-4cf8-ae1a-173d49da8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:35.166901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 22:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:13:35.320656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de211d1d-701c-4743-b687-68bda0eed95a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:35.336566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de211d1d-701c-4743-b687-68bda0eed95a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:35.343125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b515d6-c65a-4e8e-b5bf-91d665fd2d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:35.343792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b515d6-c65a-4e8e-b5bf-91d665fd2d55 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:35.344364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b515d6-c65a-4e8e-b5bf-91d665fd2d55 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:35.344364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b515d6-c65a-4e8e-b5bf-91d665fd2d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:35.355712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b515d6-c65a-4e8e-b5bf-91d665fd2d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:35.357708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b515d6-c65a-4e8e-b5bf-91d665fd2d55 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:35.369372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 773/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:39.416676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b2ae-41cb-49a8-8c46-3e727ba9d2b8 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:39.417269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b2ae-41cb-49a8-8c46-3e727ba9d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:39.417269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6b2ae-41cb-49a8-8c46-3e727ba9d2b8 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:39.418722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:39.424571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54173d-c43f-41c1-bce1-10324d250d91 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:39.425110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54173d-c43f-41c1-bce1-10324d250d91 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:39.425110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54173d-c43f-41c1-bce1-10324d250d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:39.447817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-da54173d-c43f-41c1-bce1-10324d250d91 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:39.449104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-da54173d-c43f-41c1-bce1-10324d250d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:39.458543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:39.499772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6b2ae-41cb-49a8-8c46-3e727ba9d2b8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:39.501833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-51f6b2ae-41cb-49a8-8c46-3e727ba9d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:39.577611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6b2ae-41cb-49a8-8c46-3e727ba9d2b8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:39.581867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd58ae-2a81-40ba-8b70-b178749e9455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:39.582799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd58ae-2a81-40ba-8b70-b178749e9455 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:39.583081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd58ae-2a81-40ba-8b70-b178749e9455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:39.583358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd58ae-2a81-40ba-8b70-b178749e9455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:39.593737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd58ae-2a81-40ba-8b70-b178749e9455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:39.595223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd58ae-2a81-40ba-8b70-b178749e9455 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:39.606608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 756/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:41.944948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535b06-3307-46b1-8ec2-b74372caf478 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:41.945687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535b06-3307-46b1-8ec2-b74372caf478 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:41.945687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535b06-3307-46b1-8ec2-b74372caf478 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:41.947239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:41.953708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff3f8-022d-4d25-a386-0a9d091b8a54 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:41.954331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff3f8-022d-4d25-a386-0a9d091b8a54 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:41.954331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff3f8-022d-4d25-a386-0a9d091b8a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:41.976649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c51ff3f8-022d-4d25-a386-0a9d091b8a54 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:41.978093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c51ff3f8-022d-4d25-a386-0a9d091b8a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:41.990588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:13:42.061350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf535b06-3307-46b1-8ec2-b74372caf478 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:42.068115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=75 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:42.075633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf535b06-3307-46b1-8ec2-b74372caf478 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:42.079667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86263fb8-c115-446f-98cb-f66c8c3a9ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:42.080340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263fb8-c115-446f-98cb-f66c8c3a9ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:42.080625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263fb8-c115-446f-98cb-f66c8c3a9ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:42.080930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86263fb8-c115-446f-98cb-f66c8c3a9ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:42.092250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86263fb8-c115-446f-98cb-f66c8c3a9ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:42.094274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86263fb8-c115-446f-98cb-f66c8c3a9ffd service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:42.108044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 776/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:45.866845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a4c55-06e0-49b8-bd1f-e8895c056d51 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:45.867689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a4c55-06e0-49b8-bd1f-e8895c056d51 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:45.867689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a4c55-06e0-49b8-bd1f-e8895c056d51 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:45.868841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:13:45.875027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2dce-e514-4658-a206-f8348d8785fc None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:45.875623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2dce-e514-4658-a206-f8348d8785fc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:45.875623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e2dce-e514-4658-a206-f8348d8785fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:45.897096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-970e2dce-e514-4658-a206-f8348d8785fc None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:45.898442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-970e2dce-e514-4658-a206-f8348d8785fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:45.907499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:46.206143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a4c55-06e0-49b8-bd1f-e8895c056d51 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:46.208980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ee1a4c55-06e0-49b8-bd1f-e8895c056d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:46.266837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:46.292007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a4c55-06e0-49b8-bd1f-e8895c056d51 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:46.298075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd4ad7-9e1f-429b-860c-b40f91996fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:46.299473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4ad7-9e1f-429b-860c-b40f91996fac service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:46.299986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4ad7-9e1f-429b-860c-b40f91996fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:46.300700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd4ad7-9e1f-429b-860c-b40f91996fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:46.318345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd4ad7-9e1f-429b-860c-b40f91996fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:46.321122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd4ad7-9e1f-429b-860c-b40f91996fac service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:46.341405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 759/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:48.698936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4bc2c-c581-4487-a1e0-a9c796d0373f None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:48.699585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4bc2c-c581-4487-a1e0-a9c796d0373f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:48.699585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4bc2c-c581-4487-a1e0-a9c796d0373f None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:48.700960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 22:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 22:13:48.707716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900331c-7cec-430d-8c1d-e77e77d99692 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:48.708405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900331c-7cec-430d-8c1d-e77e77d99692 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:48.708612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900331c-7cec-430d-8c1d-e77e77d99692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:48.731514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b900331c-7cec-430d-8c1d-e77e77d99692 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:13:48.732845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b900331c-7cec-430d-8c1d-e77e77d99692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:48.742540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 22:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:13:49.025267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4bc2c-c581-4487-a1e0-a9c796d0373f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:13:49.027384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3ab4bc2c-c581-4487-a1e0-a9c796d0373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:13:49.043968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4bc2c-c581-4487-a1e0-a9c796d0373f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:13:49.047708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2539e9-c020-4830-88ca-62030f08a7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:13:49.048435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2539e9-c020-4830-88ca-62030f08a7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:13:49.048775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2539e9-c020-4830-88ca-62030f08a7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:13:49.049093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2539e9-c020-4830-88ca-62030f08a7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:13:49.060359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2539e9-c020-4830-88ca-62030f08a7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:13:49.061892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2539e9-c020-4830-88ca-62030f08a7b8 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:13:49.073354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 779/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:13:58.724867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=13 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:13:59.068587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=14 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:21.997499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56ec4-2a52-4f03-adc3-e373369dca94 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:21.998380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56ec4-2a52-4f03-adc3-e373369dca94 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:21.998380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a56ec4-2a52-4f03-adc3-e373369dca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.023322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-20a56ec4-2a52-4f03-adc3-e373369dca94 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.024565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-20a56ec4-2a52-4f03-adc3-e373369dca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.035200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 761/1540] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:22.052249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.053309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.053829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.071955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb3be-bda4-45ef-9804-7555d1546dd7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.072308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb3be-bda4-45ef-9804-7555d1546dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.073138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb3be-bda4-45ef-9804-7555d1546dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.089786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.091298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.110940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f8efb3be-bda4-45ef-9804-7555d1546dd7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.111667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 780/1541] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:22.112323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f8efb3be-bda4-45ef-9804-7555d1546dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.116651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.127191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 762/1542] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:22.133884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f47027-bcd4-4c78-ab03-319898dbe454 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.139395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.139705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.139966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.146178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.146895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.147184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.147469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.148231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:22.148549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.169741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.191152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.192419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.196173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 781/1543] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:15:22.210473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.212119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 763/1544] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:15:22.216825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.237438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e883a8c5-fe2b-4ef8-9f7f-4143ca7938cd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.238224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dff52e-a1ed-4ea6-b1e9-67aa8458baa0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.246617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.247590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.247879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.248231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.248850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.249418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.250027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.250516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.250676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:15:22.250676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:15:22.250676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:15:22.251262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.252248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:22.252375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.252971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.254521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:15:22.254521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:15:22.254521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:15:22.255834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.279030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 764/1545] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:15:22.292941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.305624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 782/1546] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:22.311783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.315166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283755-015c-4dce-ada8-17280898f7b4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.457420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ec8ad-7c0b-4c3d-a85e-3ea02b90be63 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.462507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.463236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.463523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.463802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.465503 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.467554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.502738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.504244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.504568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.504854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.510406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.513033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.518310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 783/1547] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:22.525138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.544517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8e30-a7ad-44a6-8216-a61e1b691c91 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.549409 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c6202-7dda-4443-aabc-158ce75b7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.550327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6202-7dda-4443-aabc-158ce75b7150 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.550606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6202-7dda-4443-aabc-158ce75b7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.550884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c6202-7dda-4443-aabc-158ce75b7150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.551646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6202-7dda-4443-aabc-158ce75b7150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.555125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c6202-7dda-4443-aabc-158ce75b7150 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.580822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 784/1548] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:22.584271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.585284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.586044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 765/1549] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:15:22.587115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.587854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.619469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.620721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.714657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e391-b691-48ac-84f4-19cd01b96bd8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.726434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 785/1550] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:22.727421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.738565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04a8d9-5ea9-4db7-985c-cb376221f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.739295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a8d9-5ea9-4db7-985c-cb376221f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.739583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a8d9-5ea9-4db7-985c-cb376221f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.739864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04a8d9-5ea9-4db7-985c-cb376221f9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.740628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a8d9-5ea9-4db7-985c-cb376221f9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.743051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04a8d9-5ea9-4db7-985c-cb376221f9c8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.747008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f9b51-a95f-470d-b147-9737e16b8799 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.752018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.752830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.753088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.757566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.758463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.760109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 766/1551] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:22.760491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.761521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.761815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.762098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.797049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 786/1552] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:22.797934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.810565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.811846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.814981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9c666-4046-438d-941f-e1ed6735f7d1 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.826570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.827556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.827819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.828107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] PATH_INFO: `/v3/projects/09d590c4a2ca4b33864e81dfe4d10785/users/c50fa1f3fbce463d825d634ebc77f742/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.850678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 767/1553] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:22.856151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.856539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d590c4a2ca4b33864e81dfe4d10785, user_id=c50fa1f3fbce463d825d634ebc77f742, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.862710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:15:22.862710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:15:22.862710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:15:22.864840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.869667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:22.874637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68af20-c305-407a-8a74-1c0caae909f3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:22.888528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 787/1554] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:22 2022] PUT /identity/v3/projects/09d590c4a2ca4b33864e81dfe4d10785/users/c50fa1f3fbce463d825d634ebc77f742/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:22.889168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7db99-e9c9-4234-8d46-b61431eed643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:22.889346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:22.889903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7db99-e9c9-4234-8d46-b61431eed643 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.890189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7db99-e9c9-4234-8d46-b61431eed643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.890466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7db99-e9c9-4234-8d46-b61431eed643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.891215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7db99-e9c9-4234-8d46-b61431eed643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:22.892864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7db99-e9c9-4234-8d46-b61431eed643 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:22.911542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 768/1555] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:22.921808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb96e1e-f240-4c44-a08f-74f0b9d4b9fb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:22.922313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb96e1e-f240-4c44-a08f-74f0b9d4b9fb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:22.922901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb96e1e-f240-4c44-a08f-74f0b9d4b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:22.953424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8bb96e1e-f240-4c44-a08f-74f0b9d4b9fb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:22.954730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8bb96e1e-f240-4c44-a08f-74f0b9d4b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:22.997931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:23.012136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60c4a5-3e9f-4994-8889-652de45583e4 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.023299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.024692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.025211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.033047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.033047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:23.033047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.037123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.052256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 788/1556] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:23.055857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.067575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ef966-4dd8-4780-a6da-1bc8e8234c1c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.067910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 769/1557] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.069755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb08672-a89f-4224-9110-1cc72067eaf9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.070052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb08672-a89f-4224-9110-1cc72067eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.070346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb08672-a89f-4224-9110-1cc72067eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.075933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc30e6c-23e1-48b8-b7de-a09304df3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.076967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc30e6c-23e1-48b8-b7de-a09304df3e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.077524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc30e6c-23e1-48b8-b7de-a09304df3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.078017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc30e6c-23e1-48b8-b7de-a09304df3e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.079002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc30e6c-23e1-48b8-b7de-a09304df3e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.081310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc30e6c-23e1-48b8-b7de-a09304df3e92 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.096452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 789/1558] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:23.101591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.101834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bcb08672-a89f-4224-9110-1cc72067eaf9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.101834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bcb08672-a89f-4224-9110-1cc72067eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.102728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.103220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.111728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 770/1559] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.117878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.118408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.119427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.123369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.124861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.139472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 790/1560] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.140623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.151381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8cace-a8dc-47b5-84c7-6b8395b31c1c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.153713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.155336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.157065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.158626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.159401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.159852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.160815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.163196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.169686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 771/1561] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.170978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.197263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 791/1562] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:23.198535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.260054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae703d7-939a-4d8f-8428-333fd1ec1d73 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.275162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1cf22-8d2b-4fc6-a5b9-29a82ee46b63 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.280098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245cda2-00b1-4de0-94e9-be9cd134bb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.281200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cda2-00b1-4de0-94e9-be9cd134bb33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.281668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cda2-00b1-4de0-94e9-be9cd134bb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.281948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245cda2-00b1-4de0-94e9-be9cd134bb33 admin admin] PATH_INFO: `/v3/projects/e1c37e59766f45c3a46489befb803ff3/users/728f1fbe76564467b378035d0d2d3be5/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.300146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245cda2-00b1-4de0-94e9-be9cd134bb33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c37e59766f45c3a46489befb803ff3, user_id=728f1fbe76564467b378035d0d2d3be5, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.302787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245cda2-00b1-4de0-94e9-be9cd134bb33 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.317166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 792/1563] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:23 2022] PUT /identity/v3/projects/e1c37e59766f45c3a46489befb803ff3/users/728f1fbe76564467b378035d0d2d3be5/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:23.318684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc029-927b-49e2-968c-467a50f59ea0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.318887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc029-927b-49e2-968c-467a50f59ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.319241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc029-927b-49e2-968c-467a50f59ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.320824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80746aa-a4f7-4ddc-9070-17add118d6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.321456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80746aa-a4f7-4ddc-9070-17add118d6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.322064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80746aa-a4f7-4ddc-9070-17add118d6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.322064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80746aa-a4f7-4ddc-9070-17add118d6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.336756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80746aa-a4f7-4ddc-9070-17add118d6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.338267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80746aa-a4f7-4ddc-9070-17add118d6f4 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.340212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-58bbc029-927b-49e2-968c-467a50f59ea0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.341442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-58bbc029-927b-49e2-968c-467a50f59ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.349357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 772/1564] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:23.353271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.353271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.353271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.375003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.376340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.377601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:23.415380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 793/1565] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.417727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0903a-1090-44c2-9963-29f36481e8d5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.418019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0903a-1090-44c2-9963-29f36481e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.418294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0903a-1090-44c2-9963-29f36481e8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.438673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-78b0903a-1090-44c2-9963-29f36481e8d5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.440048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-78b0903a-1090-44c2-9963-29f36481e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.451561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 794/1566] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.452848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6dae-235e-457e-8395-7e4c98c619b0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.453136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6dae-235e-457e-8395-7e4c98c619b0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.453439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6dae-235e-457e-8395-7e4c98c619b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.457406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 773/1567] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.460778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.474312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a88ad-f195-486d-980b-20e6073f3774 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.477966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d5eb6dae-235e-457e-8395-7e4c98c619b0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.479265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d5eb6dae-235e-457e-8395-7e4c98c619b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.481179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.482080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.482548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.483231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.483926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.485305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:15:23.485305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:15:23.485305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:15:23.489733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 795/1568] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.491151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046696f9-9355-4530-b53c-f39eeeb903ec None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.491502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046696f9-9355-4530-b53c-f39eeeb903ec None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.492203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046696f9-9355-4530-b53c-f39eeeb903ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.500127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.512768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-046696f9-9355-4530-b53c-f39eeeb903ec None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.514022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-046696f9-9355-4530-b53c-f39eeeb903ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.523613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:23.526024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 796/1569] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.527362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb22d06-9fcd-4173-a0e3-b25b2184d60f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.527658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb22d06-9fcd-4173-a0e3-b25b2184d60f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.527976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb22d06-9fcd-4173-a0e3-b25b2184d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.543323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 774/1570] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/users => generated 284 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:23.543323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.555785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cdb22d06-9fcd-4173-a0e3-b25b2184d60f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.557148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1879a4e-71bd-447c-b584-4b452d86cf78 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.557708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cdb22d06-9fcd-4173-a0e3-b25b2184d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.566192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.567809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.568088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.568359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.569117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:23.569506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.575640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.578668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 797/1571] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.590511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.590846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.591072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.599881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 775/1572] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:23.600993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.617132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a9a04-df47-4eeb-8e0c-b50091b05548 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.620861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.622771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.626571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.627333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.627717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.628364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.629260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:23.629686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.634925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 798/1573] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.640310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.644483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5d76-a2eb-42d3-b84e-e125e5cc9d18 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.655335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d10602-8024-46e6-87fc-3f07b3bd1694 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.662096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.662895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.663245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.663594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.664416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:23.664798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.666588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.667400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 776/1574] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:23.668623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.669215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.669518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.694256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:23.696571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.697669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 799/1575] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:23.700138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.713471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 777/1576] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:23.713471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.713929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a48df3-9471-43f1-a6c7-53c80634404c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.714038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:23.720055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.721419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.722759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.723234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.724249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.726900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.741681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 800/1577] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:23.742879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.754405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2b338-87cb-4c27-bbfb-1e56b166ea03 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.760828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.761660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.762004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.762339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.763102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.765040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.804269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9de246-d301-4d91-bc4b-f67602b92507 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.809834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.810802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.811273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.811747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.812230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 801/1578] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:23.814334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.835418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.837409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.852594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 778/1579] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:23.854258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.869547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3990c-8da4-4af6-867e-4b284e8df93f service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.934106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd239-a2e1-4201-bd95-7ece3787f969 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.945261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.946794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.947465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.948175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.949906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:23.950739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.954228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:23.974298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 802/1580] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:23.975664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:23.995408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:23.996184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:23.996551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:23.996813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:23.997494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804df7-f368-44ed-80de-22a2d0d6c07c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:23.997622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:23.999600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.004326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.005398 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.005747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.006040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.006889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.009004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.038179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 779/1581] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.039808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.055423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 803/1582] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:23 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.060430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.105160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:24.149856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:24.154061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05c625-c656-40df-8437-ee4979cb8c7e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.161155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.161512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404fbd4-9ea6-407a-9f63-a2000a85851e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.162114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.162390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.162718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.163467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.165131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.167029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.167948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.168297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.168955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.169621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:24.169943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.171844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.181201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 804/1583] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:24.181201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.187971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 780/1584] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:24.189073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.193026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6c5a5-f2e4-4726-9510-d1d2ad3a214c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.198061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.199056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.199056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.199345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.200099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.202486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.202671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982ef0-4bf7-49fb-a75f-a20724b07a0b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.207825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.208654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.209048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.209352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.210247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.212381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.235094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 805/1585] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/users => generated 287 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.236047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.251423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c7277-8e3b-428d-8f4f-a5ca3ff4c0a8 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.257761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.258541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.258832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.259107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.260418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.262087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.274185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 781/1586] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.274620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.289633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 806/1587] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.293603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.310683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5567adf-3841-44f1-aabe-d22c5008dfe7 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.384037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ef5c4-4fca-4c19-9d10-a439487ba4b2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.392203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.393292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.393816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.394373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.395942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.399511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.416747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.418618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.419081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.419590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] PATH_INFO: `/v3/projects/747de57511cf4f8a9e5b2503d7550c84/users/b5452ef297b1440788b808f4690a00fd/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.443914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 782/1588] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.444934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.459465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747de57511cf4f8a9e5b2503d7550c84, user_id=b5452ef297b1440788b808f4690a00fd, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.459695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1a37b-57f3-4782-916e-8a1b65279ca6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.467263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.484067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.484775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.485062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.485355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.486905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.489097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.507378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 807/1589] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:24 2022] PUT /identity/v3/projects/747de57511cf4f8a9e5b2503d7550c84/users/b5452ef297b1440788b808f4690a00fd/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:24.507378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.545942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 783/1590] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.545942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.652447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c87ca-4fca-4ca3-8df2-9397a0661b58 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.662501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471ee8-121c-47ef-86f8-a8aa85371705 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.667466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.668176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.668459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.668734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.669676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.671488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.672612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.672612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.672937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.673736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.676023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.679232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.692010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 808/1591] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:24.695699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.708985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 784/1592] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.709245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f43eb2-fbe6-4236-96d8-1631572b1197 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.709363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.718060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef5bd0-0cf6-49ba-868e-9ea04b6bc66d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.719014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25b025-209d-4b1d-9255-626ee228b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.719880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b025-209d-4b1d-9255-626ee228b197 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.720166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b025-209d-4b1d-9255-626ee228b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.721734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b025-209d-4b1d-9255-626ee228b197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.722666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25b025-209d-4b1d-9255-626ee228b197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.724193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25b025-209d-4b1d-9255-626ee228b197 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.726474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:24.731318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.733226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.734502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.735987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.736769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.741460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 809/1593] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:24.741993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.743972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.744308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.744620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.760845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 785/1594] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:24.762477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.774925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] MFA Rules not processed for user `b5452ef297b1440788b808f4690a00fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:24.776195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:24.778071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f4bb-70be-4e64-a283-38013f72830a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.793138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f1003-18e2-4cf0-8da4-9cd8515fb990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.794420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1003-18e2-4cf0-8da4-9cd8515fb990 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.795501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1003-18e2-4cf0-8da4-9cd8515fb990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.795974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f1003-18e2-4cf0-8da4-9cd8515fb990 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.797641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f1003-18e2-4cf0-8da4-9cd8515fb990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.800005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f1003-18e2-4cf0-8da4-9cd8515fb990 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.815422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:24.833633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 786/1595] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/users => generated 297 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:24.835069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.835366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.835711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.886993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 810/1596] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:24.886993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.896882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] MFA Rules not processed for user `c50fa1f3fbce463d825d634ebc77f742`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:24.900309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:24.919979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eef5a-db9c-4998-b856-9cbf98f452de None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.940420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.941605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.941894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.942175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.943494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.946152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.962855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 811/1597] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:24.962855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:24.971924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3dd2-6c42-4a5b-a189-ace969a98f22 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:24.977345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:24.978091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:24.978380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:24.979124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:24.979396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:24.981148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:24.993135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 812/1598] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:24.994160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.005579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 787/1599] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:25.006678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.021578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433291-cb3b-40ff-9dbf-23afe1379540 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.023398 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934da83-6ced-41e8-9f3c-ab6caf273b13 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.026795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.027844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.028295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.028740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.029555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.029698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.031768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.031905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.032059 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.032343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.033598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.037037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.046560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 788/1600] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:25.047738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.061499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 813/1601] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:25.061499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.062171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc9c26-468a-4e55-b4c0-61ddfd9d6d1d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.066875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.067806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.068157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.068516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.069676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.071409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.087227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 789/1602] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:25.088555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.104608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0f624-b0ac-4d74-9649-9112ac852105 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.110288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.111341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.111833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.112612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] PATH_INFO: `/v3/projects/8937185412da45feb828a2dec596f359/users/81a18deda10a4b74a1d6dcd135a6a385/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.135863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7215cc-52d1-4b76-bd9a-283abae2fe28 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.138390 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8937185412da45feb828a2dec596f359, user_id=81a18deda10a4b74a1d6dcd135a6a385, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.140560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.146325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.147018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.147848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.147848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.163688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.165241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.182823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 790/1603] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:25 2022] PUT /identity/v3/projects/8937185412da45feb828a2dec596f359/users/81a18deda10a4b74a1d6dcd135a6a385/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:25.182823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.185958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 814/1604] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:25.187423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.202975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791fcca4-f907-4573-9ba4-8170bb344194 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.298636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f64d98-a932-45d3-9be2-56d8e903821b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.308398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.309372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.309659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.309931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.310687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.311166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:25.316250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.322954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.323805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.324091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.324372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.325107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.331986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.336871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 791/1605] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:25.338458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.368058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b7490-d921-4a27-8efc-b211f7bbb026 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.378897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.379649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.379933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.380213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] PATH_INFO: `/v3/projects/e2dec64625f54967a0032506f799ed6a/users/c10fe54c24554b4db6783014a85cfa72/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.396038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 815/1606] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:25 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:25.398239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.421120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dec64625f54967a0032506f799ed6a, user_id=c10fe54c24554b4db6783014a85cfa72, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.423906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.456067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 792/1607] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:25 2022] PUT /identity/v3/projects/e2dec64625f54967a0032506f799ed6a/users/c10fe54c24554b4db6783014a85cfa72/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:25.456067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.486903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:25.506827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a35fb-39b2-44d7-99ce-35bfad9677b7 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.584554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.585578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.586055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.586338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] PATH_INFO: `/v3/projects/0d340df02c724bee810b3f8874379cfc/users/5fd1bd3a55de406d9f4b2adf35bef024/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.588848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00ceb6-d5b3-491a-a296-15acbf9dba92 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.608162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366e396-b9a4-45b3-a73f-5f07f2d4dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.609163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366e396-b9a4-45b3-a73f-5f07f2d4dbdf admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.609723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366e396-b9a4-45b3-a73f-5f07f2d4dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.610069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366e396-b9a4-45b3-a73f-5f07f2d4dbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.610888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366e396-b9a4-45b3-a73f-5f07f2d4dbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.612793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366e396-b9a4-45b3-a73f-5f07f2d4dbdf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.618254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d340df02c724bee810b3f8874379cfc, user_id=5fd1bd3a55de406d9f4b2adf35bef024, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.624703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.639840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 793/1608] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:25.641481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.641789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.642061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.667540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 816/1609] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:25 2022] PUT /identity/v3/projects/0d340df02c724bee810b3f8874379cfc/users/5fd1bd3a55de406d9f4b2adf35bef024/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:25.668848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.686042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] MFA Rules not processed for user `81a18deda10a4b74a1d6dcd135a6a385`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:25.689313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:25.807068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96535a1c-136a-43a8-b796-7707edbbbe46 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.817373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 794/1610] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:25.818368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.823218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16687ef8-2a9b-4862-b4b4-788007aa1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.824148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687ef8-2a9b-4862-b4b4-788007aa1b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.824430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687ef8-2a9b-4862-b4b4-788007aa1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.824704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16687ef8-2a9b-4862-b4b4-788007aa1b14 admin admin] PATH_INFO: `/v3/projects/efbd608ab5ef48df97bbef4aaad5f1fd/users/4967de0fbea84d5c8153f26b72aaa0ec/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.851505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16687ef8-2a9b-4862-b4b4-788007aa1b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbd608ab5ef48df97bbef4aaad5f1fd, user_id=4967de0fbea84d5c8153f26b72aaa0ec, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.854353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16687ef8-2a9b-4862-b4b4-788007aa1b14 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.854729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14181ee-ef3d-47d4-8eb6-2be6319251a9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:25.859995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:25.875069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:25.880259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.880572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.880860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.884382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 817/1611] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:25 2022] PUT /identity/v3/projects/efbd608ab5ef48df97bbef4aaad5f1fd/users/4967de0fbea84d5c8153f26b72aaa0ec/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:25.884938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:25.885937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33029-2c9a-4ec6-a817-02e712579f7e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:25.886295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33029-2c9a-4ec6-a817-02e712579f7e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:25.886654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33029-2c9a-4ec6-a817-02e712579f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:25.886977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:25.926565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 795/1612] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:25 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:25.927227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:25.937895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-06e33029-2c9a-4ec6-a817-02e712579f7e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:25.939196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-06e33029-2c9a-4ec6-a817-02e712579f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:25.953129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b0830-5f93-42c7-a22b-37cd42601204 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.054415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d462f-6fe2-42a9-9181-1b2722259dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.055736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d462f-6fe2-42a9-9181-1b2722259dae admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.056002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d462f-6fe2-42a9-9181-1b2722259dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.056292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d462f-6fe2-42a9-9181-1b2722259dae admin admin] PATH_INFO: `/v3/projects/0713040636b4408c95dcadbb9b1fe3cc/users/9be9445fdbc4459da4feb7c0bc1b310f/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.112049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 818/1613] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:26.115138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e355-e492-488b-a589-db9056aa505c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.115138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e355-e492-488b-a589-db9056aa505c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.115138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529e355-e492-488b-a589-db9056aa505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.127526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d462f-6fe2-42a9-9181-1b2722259dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0713040636b4408c95dcadbb9b1fe3cc, user_id=9be9445fdbc4459da4feb7c0bc1b310f, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.137928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d462f-6fe2-42a9-9181-1b2722259dae admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.159084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b529e355-e492-488b-a589-db9056aa505c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:26.165574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b529e355-e492-488b-a589-db9056aa505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:26.165896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 796/1614] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:25 2022] PUT /identity/v3/projects/0713040636b4408c95dcadbb9b1fe3cc/users/9be9445fdbc4459da4feb7c0bc1b310f/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:26.167254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd97820-0489-4b1f-8542-9d2b4bb235e4 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.167541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd97820-0489-4b1f-8542-9d2b4bb235e4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.167817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd97820-0489-4b1f-8542-9d2b4bb235e4 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.169857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 797/1615] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 15 22:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:26.171570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5f38-e56b-4f9e-a044-190127578eb3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.171856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5f38-e56b-4f9e-a044-190127578eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.172177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5f38-e56b-4f9e-a044-190127578eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.179406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:26.233439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1b1c5f38-e56b-4f9e-a044-190127578eb3 None None] MFA Rules not processed for user `4967de0fbea84d5c8153f26b72aaa0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:26.233439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1b1c5f38-e56b-4f9e-a044-190127578eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:26.284835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 819/1616] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:26.284835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e355-e492-488b-a589-db9056aa505c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.310953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529e355-e492-488b-a589-db9056aa505c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.327533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.328459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.328865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.329028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.329822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.332637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.350023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 820/1617] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:26.351017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.365087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 798/1618] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:26.370332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41c11-8945-4526-97cc-ba15510e743e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.370644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41c11-8945-4526-97cc-ba15510e743e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.370904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db41c11-8945-4526-97cc-ba15510e743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.420797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6db41c11-8945-4526-97cc-ba15510e743e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:26.422599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6db41c11-8945-4526-97cc-ba15510e743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:26.484902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 799/1619] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:26.484902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.484902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.484902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.493047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:26.494348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:26.515109 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6a1f-608d-4148-8ce4-97a11766e765 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.527251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.529105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.530452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.530814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.552116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.560766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.581921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 821/1620] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:26.584014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.612850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01698fb-b12e-450a-8c20-0be3938ef6f4 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.628965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.630378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.630946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.631426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.653898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.660356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.666947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 800/1621] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 15 22:15:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:26.668605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.683671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 822/1622] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:26.684978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.700098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19d05-e58a-4092-b933-aa1d559592f0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.702115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629dd98-6cc4-422e-b9fa-444993bb788b service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.711559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.712309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.712597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.712869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.713684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.714655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.715703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.716161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.725847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.726279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] PATH_INFO: `/v3/projects/a689d5d1e6f64cd6afb4aad7a93cb38e/users/8d0993076a4f4e62b387cfaacc204a7d/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.733305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:26.748873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a689d5d1e6f64cd6afb4aad7a93cb38e, user_id=8d0993076a4f4e62b387cfaacc204a7d, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.752035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.769776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 823/1623] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:26 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:26.770919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.772763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 801/1624] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:26 2022] PUT /identity/v3/projects/a689d5d1e6f64cd6afb4aad7a93cb38e/users/8d0993076a4f4e62b387cfaacc204a7d/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:26.774005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:26.874483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0d301-f9a9-46dc-993a-002ccb4abefb admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.878950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:26.879964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:26.880496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:26.880779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:26.882071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:26.910216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af2119-e1dd-4069-a3e3-2a5b47fd92fc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:26.972924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:26.974633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:26.987682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 824/1625] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:26.989081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.003222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b274854-104c-4753-906b-069b70d11eaa service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.009216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.010019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.010307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.010582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.011493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.014122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.037770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.039178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.039535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.039873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.045641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 825/1626] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:26 2022] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:27.050210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.063351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5a406-6ab7-4009-a8b9-04f737daad1a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.070771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.072391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.072923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.073492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.074937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.077251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.097535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 826/1627] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:27.099132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.118650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a8a86-574b-4c8d-a292-04f4b22468ee admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.125260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.126023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.126460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.126753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.127687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.128512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.129720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.131108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.141876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 802/1628] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:27.142835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.143880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 827/1629] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:27.150048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.156703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc08c4-44b1-40a5-8977-04b205a59e5e service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.163442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.164393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.164712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.165021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] PATH_INFO: `/v3/projects/a689d5d1e6f64cd6afb4aad7a93cb38e/users/8d0993076a4f4e62b387cfaacc204a7d/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.166701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bc82e-a0f6-41d0-8757-9ef0e90fce48 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.167268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a689d5d1e6f64cd6afb4aad7a93cb38e, user_id=8d0993076a4f4e62b387cfaacc204a7d, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.172560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.175258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.176572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.176991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.177344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] PATH_INFO: `/v3/projects/77f37f71dade4bfc9407005c2982709e/users/d84a77e46def463faacd4c355c45f60f/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.202103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 803/1630] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:27 2022] PUT /identity/v3/projects/a689d5d1e6f64cd6afb4aad7a93cb38e/users/8d0993076a4f4e62b387cfaacc204a7d/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:27.207629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f37f71dade4bfc9407005c2982709e, user_id=d84a77e46def463faacd4c355c45f60f, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.210841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.235146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 828/1631] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:27 2022] PUT /identity/v3/projects/77f37f71dade4bfc9407005c2982709e/users/d84a77e46def463faacd4c355c45f60f/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:27.236176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.339363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61bb08-7aaa-4135-87a5-a83e134a733d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.367277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:27.468340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba0e67-3b90-453f-8712-2d015228dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.469744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0e67-3b90-453f-8712-2d015228dcab admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.470266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0e67-3b90-453f-8712-2d015228dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.470782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba0e67-3b90-453f-8712-2d015228dcab admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.472631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba0e67-3b90-453f-8712-2d015228dcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.474377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba0e67-3b90-453f-8712-2d015228dcab admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.498482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.508738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 804/1632] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:27.513836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c783-70b2-4117-aaa3-af1e6a48f286 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:27.542139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e6fe-830d-4940-99a5-d2990164da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:27.542139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e6fe-830d-4940-99a5-d2990164da92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.544049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e6fe-830d-4940-99a5-d2990164da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.544356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e6fe-830d-4940-99a5-d2990164da92 admin admin] PATH_INFO: `/v3/projects/77f37f71dade4bfc9407005c2982709e/users/d84a77e46def463faacd4c355c45f60f/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.550477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e6fe-830d-4940-99a5-d2990164da92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f37f71dade4bfc9407005c2982709e, user_id=d84a77e46def463faacd4c355c45f60f, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:27.559010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e6fe-830d-4940-99a5-d2990164da92 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:27.627872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 829/1633] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:27 2022] PUT /identity/v3/projects/77f37f71dade4bfc9407005c2982709e/users/d84a77e46def463faacd4c355c45f60f/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:27.629068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.629673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.630208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.731723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] MFA Rules not processed for user `d84a77e46def463faacd4c355c45f60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:27.733622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:27.898665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a2b19-052a-4265-ac9e-0650cd956b87 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.899136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a2b19-052a-4265-ac9e-0650cd956b87 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.899754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a2b19-052a-4265-ac9e-0650cd956b87 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.904815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 830/1634] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 15 22:15:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:27.916372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c18d39-19bf-47c3-9de0-09bca3900c0d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:27.916968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c18d39-19bf-47c3-9de0-09bca3900c0d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:27.918121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c18d39-19bf-47c3-9de0-09bca3900c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:27.948319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 805/1635] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:27.955728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:27.971757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f4c18d39-19bf-47c3-9de0-09bca3900c0d None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:27.974268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f4c18d39-19bf-47c3-9de0-09bca3900c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:28.026839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:28.154075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017ff24-557a-4718-b860-d06626ec7641 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:28.171638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d7b1d-5e18-43ed-a596-fa571aa4ad55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:28.174156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d7b1d-5e18-43ed-a596-fa571aa4ad55 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.175863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d7b1d-5e18-43ed-a596-fa571aa4ad55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.179063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d7b1d-5e18-43ed-a596-fa571aa4ad55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.231905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d7b1d-5e18-43ed-a596-fa571aa4ad55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:28.238620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d7b1d-5e18-43ed-a596-fa571aa4ad55 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:28.285646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 831/1636] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:28.289565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47001c6a-620e-484c-83e4-7e62161cf934 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.291057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47001c6a-620e-484c-83e4-7e62161cf934 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.294068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47001c6a-620e-484c-83e4-7e62161cf934 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.299953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 806/1637] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:15:28.301559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 832/1638] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jun 15 22:15:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:28.320619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fad702-2e97-472d-983f-98238e12fe16 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.321080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fad702-2e97-472d-983f-98238e12fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.323939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47001c6a-620e-484c-83e4-7e62161cf934 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:28.327711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fad702-2e97-472d-983f-98238e12fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.369172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47001c6a-620e-484c-83e4-7e62161cf934 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:28.388435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:28.391303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.392074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.392306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.401362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-14fad702-2e97-472d-983f-98238e12fe16 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:28.404408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-14fad702-2e97-472d-983f-98238e12fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:28.427509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:28.429470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:28.435367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 807/1639] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jun 15 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:28.447595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900bdb-c27d-444c-a8be-31d6ca06dafd None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.448109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900bdb-c27d-444c-a8be-31d6ca06dafd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.448109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900bdb-c27d-444c-a8be-31d6ca06dafd None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.450022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 808/1640] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 15 22:15:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:28.459365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 833/1641] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:28.464715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.465045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.465353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.490938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:28.492845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:28.510164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 809/1642] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:28.560413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:28.593688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd54a57-8bb4-4438-b467-2c0359fa07fc service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:28.604634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb39af2-eb99-4677-9f74-01025528555b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:28.607740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39af2-eb99-4677-9f74-01025528555b service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:28.608978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39af2-eb99-4677-9f74-01025528555b service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:28.612107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39af2-eb99-4677-9f74-01025528555b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:28.654106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39af2-eb99-4677-9f74-01025528555b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:28.660231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39af2-eb99-4677-9f74-01025528555b service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:28.721979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 834/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:15:30.400704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:30.468033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:30.541342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0010b4-d4fe-4cb3-9be6-e34ad1567b0a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:30.548807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:30.552767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:30.552767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:30.552767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] PATH_INFO: `/v3/users/4967de0fbea84d5c8153f26b72aaa0ec` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:30.553540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4967de0fbea84d5c8153f26b72aaa0ec)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:30.557177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:30.666208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4967de0fbea84d5c8153f26b72aaa0ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:30.684341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4967de0fbea84d5c8153f26b72aaa0ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:30.708736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4967de0fbea84d5c8153f26b72aaa0ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:30.710059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4967de0fbea84d5c8153f26b72aaa0ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:30.747983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4967de0fbea84d5c8153f26b72aaa0ec'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:30.766441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 810/1644] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:30 2022] DELETE /identity/v3/users/4967de0fbea84d5c8153f26b72aaa0ec => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:30.771393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526aba-71b0-4935-bfae-2dfe63c43cd6 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:30.772404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526aba-71b0-4935-bfae-2dfe63c43cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:30.772404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526aba-71b0-4935-bfae-2dfe63c43cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:30.810463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-36526aba-71b0-4935-bfae-2dfe63c43cd6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:30.816188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-36526aba-71b0-4935-bfae-2dfe63c43cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:30.987139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 835/1645] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:31.013573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:31.015710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:31.384091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d3679-805f-438f-be2b-e24c00370abc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:31.394351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:31.395047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:31.395328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:31.395600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:31.458002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:31.458002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:31.470051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 811/1646] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:32.439593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:32.440141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:32.440245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:32.506897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] MFA Rules not processed for user `8d0993076a4f4e62b387cfaacc204a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:32.508233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:32.820871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 836/1647] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:32.853025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:32.854840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:32.880243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bcdc3-ad0d-429b-8168-53e7ecfeb6ca service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:32.896874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:32.897848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:32.898124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:32.898799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] PATH_INFO: `/v3/users/81a18deda10a4b74a1d6dcd135a6a385` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:32.900298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a18deda10a4b74a1d6dcd135a6a385)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:32.902332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:32.929026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:32.934120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:32.969228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dcfe5-8bf6-4760-94a4-17b8b83db15a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:32.998342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:33.001478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:33.005009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:33.006789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] PATH_INFO: `/v3/projects/efbd608ab5ef48df97bbef4aaad5f1fd` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:33.013972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbd608ab5ef48df97bbef4aaad5f1fd)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:33.033345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:33.040904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a18deda10a4b74a1d6dcd135a6a385'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.047753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:33.060845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a18deda10a4b74a1d6dcd135a6a385'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.066947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:33.086251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a18deda10a4b74a1d6dcd135a6a385'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.088608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a18deda10a4b74a1d6dcd135a6a385'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.120856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e8ebff0a-f72e-4b33-bd12-8002e47eb877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a18deda10a4b74a1d6dcd135a6a385'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.141671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 812/1648] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:32 2022] DELETE /identity/v3/users/81a18deda10a4b74a1d6dcd135a6a385 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:33.146601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:33.146903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:33.147182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:33.170052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbd608ab5ef48df97bbef4aaad5f1fd', 'request_id': 'req-154d6b04-4ab8-483a-b97c-a40bf966ba95'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.177736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbd608ab5ef48df97bbef4aaad5f1fd', 'request_id': 'req-154d6b04-4ab8-483a-b97c-a40bf966ba95'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.185908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbd608ab5ef48df97bbef4aaad5f1fd', 'request_id': 'req-154d6b04-4ab8-483a-b97c-a40bf966ba95'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.204762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:33.210300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:33.213714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] The token cache is being invalidate because project efbd608ab5ef48df97bbef4aaad5f1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:33.214118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.215359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.222220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 837/1649] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:32 2022] DELETE /identity/v3/projects/efbd608ab5ef48df97bbef4aaad5f1fd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:33.234292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:33.238162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:33.326601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 813/1650] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:33.434930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d6b04-4ab8-483a-b97c-a40bf966ba95 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:33.441007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:33.442141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:33.442528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:33.443020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] PATH_INFO: `/v3/users/d84a77e46def463faacd4c355c45f60f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:33.444430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84a77e46def463faacd4c355c45f60f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:33.445847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: WARNING py.warnings [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:15:33.445847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: warnings.warn(msg) Jun 15 22:15:33.445847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: Jun 15 22:15:33.448048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:33.494411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:33.496097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:33.589797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84a77e46def463faacd4c355c45f60f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.616224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84a77e46def463faacd4c355c45f60f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.617208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84a77e46def463faacd4c355c45f60f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.681446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3aac0-1310-4888-9f4f-e21b57fd2405 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:33.684908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84a77e46def463faacd4c355c45f60f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.690702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618909d-58d7-49de-8072-7d16d5daedb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:33.691945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618909d-58d7-49de-8072-7d16d5daedb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:33.692433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618909d-58d7-49de-8072-7d16d5daedb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:33.693202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618909d-58d7-49de-8072-7d16d5daedb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:33.711171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618909d-58d7-49de-8072-7d16d5daedb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:33.713633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618909d-58d7-49de-8072-7d16d5daedb7 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:33.726187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7ae64885-225e-45d8-8a07-037d11cc2f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84a77e46def463faacd4c355c45f60f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:33.728370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 814/1651] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:33.736380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 838/1652] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:33 2022] DELETE /identity/v3/users/d84a77e46def463faacd4c355c45f60f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:35.716427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7067e2-fa2b-4a3c-9740-e247ba4438c8 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:35.717071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7067e2-fa2b-4a3c-9740-e247ba4438c8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:35.717071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7067e2-fa2b-4a3c-9740-e247ba4438c8 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:35.718831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 815/1653] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:35.785286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb963-df8c-4d8d-a5d4-b62fbc966e83 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:35.786445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb963-df8c-4d8d-a5d4-b62fbc966e83 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:35.787653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cb963-df8c-4d8d-a5d4-b62fbc966e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:35.845063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-629cb963-df8c-4d8d-a5d4-b62fbc966e83 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:35.847293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-629cb963-df8c-4d8d-a5d4-b62fbc966e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:35.889599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:36.040330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 839/1654] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:15:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:36.446585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223811-6cd7-4c17-ad38-b04126cb23db None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:36.446986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223811-6cd7-4c17-ad38-b04126cb23db None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:36.447421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223811-6cd7-4c17-ad38-b04126cb23db None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:36.452882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 816/1655] 10.222.0.55 () {54 vars in 960 bytes} [Wed Jun 15 22:15:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:36.457952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:36.458243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:36.458519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:36.495227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:36.496524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:36.528378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 840/1656] 10.222.0.55 () {58 vars in 1057 bytes} [Wed Jun 15 22:15:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:36.537317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59223811-6cd7-4c17-ad38-b04126cb23db None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:36.615270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59223811-6cd7-4c17-ad38-b04126cb23db None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:36.622127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c49c3f-0570-4f55-a7f0-2a2f0e277e34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:36.622977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c49c3f-0570-4f55-a7f0-2a2f0e277e34 service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:36.623425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c49c3f-0570-4f55-a7f0-2a2f0e277e34 service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:36.623900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c49c3f-0570-4f55-a7f0-2a2f0e277e34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:36.651130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c49c3f-0570-4f55-a7f0-2a2f0e277e34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:36.656045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c49c3f-0570-4f55-a7f0-2a2f0e277e34 service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:36.706134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 817/1657] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:36.906841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:36.908806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:37.116461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc487-cb77-4860-b812-12d97aff1136 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:37.124512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:37.126038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:37.126380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:37.126663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] PATH_INFO: `/v3/projects/8937185412da45feb828a2dec596f359` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:37.129885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8937185412da45feb828a2dec596f359)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:37.133036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:37.288271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8937185412da45feb828a2dec596f359', 'request_id': 'req-68cd18d0-7488-4ddd-85a1-c7debeacaa26'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.297045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8937185412da45feb828a2dec596f359', 'request_id': 'req-68cd18d0-7488-4ddd-85a1-c7debeacaa26'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.307580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8937185412da45feb828a2dec596f359', 'request_id': 'req-68cd18d0-7488-4ddd-85a1-c7debeacaa26'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.348796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] The token cache is being invalidate because project 8937185412da45feb828a2dec596f359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:37.349589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.350498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-68cd18d0-7488-4ddd-85a1-c7debeacaa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.352932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 841/1658] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:36 2022] DELETE /identity/v3/projects/8937185412da45feb828a2dec596f359 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:37.359364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:37.359915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:37.359915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:37.407115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:37.413627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:37.584000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:37.605982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 818/1659] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:37.618227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:37.618496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:37.618779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:37.688123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:37.689445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:37.708965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 842/1660] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:15:37.716529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:37.723745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:37.726799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:37.741245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438d2e1-e92d-47ec-a833-9068cc185ecd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:37.761225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:37.762678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:37.763187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:37.763675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:37.765085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:37.765695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:37.765828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42f62c-3acd-4227-88d2-899ba3151729 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:37.769555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:37.779887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:37.781375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:37.781375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:37.781631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] PATH_INFO: `/v3/projects/77f37f71dade4bfc9407005c2982709e` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:37.785692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f37f71dade4bfc9407005c2982709e)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:37.787577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:37.869825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 819/1661] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:37.873233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:37.875018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:37.897457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35113ee-d97b-4f7d-b2d4-aab7a1553383 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:37.923018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f37f71dade4bfc9407005c2982709e', 'request_id': 'req-be3f6f6f-6236-45a9-a6b1-445967df079a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.942006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f37f71dade4bfc9407005c2982709e', 'request_id': 'req-be3f6f6f-6236-45a9-a6b1-445967df079a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.958871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f37f71dade4bfc9407005c2982709e', 'request_id': 'req-be3f6f6f-6236-45a9-a6b1-445967df079a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.982127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] The token cache is being invalidate because project 77f37f71dade4bfc9407005c2982709e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:37.982494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.983713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-be3f6f6f-6236-45a9-a6b1-445967df079a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:37.990074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 843/1662] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:37 2022] DELETE /identity/v3/projects/77f37f71dade4bfc9407005c2982709e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:37.998904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc145c65-25b4-45fe-bf4a-ba2357d4a427 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:37.999261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc145c65-25b4-45fe-bf4a-ba2357d4a427 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:37.999476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc145c65-25b4-45fe-bf4a-ba2357d4a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.061413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cc145c65-25b4-45fe-bf4a-ba2357d4a427 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:38.064286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cc145c65-25b4-45fe-bf4a-ba2357d4a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:38.093267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:38.094015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.094301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.094581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.095321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:38.105556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:38.197105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 820/1663] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:37 2022] POST /identity/v3/projects => generated 403 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:38.199318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.206431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:38.325794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 844/1664] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:38.334831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.335120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.335410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.378716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:38.380845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:38.424295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29d5a-8669-4b4a-9baa-99b16b82bf48 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:38.439763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:38.440666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.440949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.441477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.442399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:38.444614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:38.470418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 845/1665] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:38.472289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.488861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb3a0a-69df-49ad-adcb-6ff8fb678570 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:38.496769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:38.498272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.498557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.498844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.499740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:38.500060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:38.500801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 821/1666] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:38 2022] POST /identity/v3/users => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:15:38.505548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:38.507828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.536757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999fabc-3211-4e5c-a8cb-51b8bbf2a897 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:38.543239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 846/1667] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:38.544922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.555872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:38.556856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.557289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.557732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.558644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:38.560531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:38.587242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 822/1668] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:38.593050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.616880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42ed23-ae33-499a-bec4-fd273673f74d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:38.649918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7956-bbfa-4c0f-bc97-3f60540d8b9c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:38.651283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:38.652836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.653013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.653734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.663023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:38.668626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:38.696287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:38.697573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:38.702983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:38.704042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:38.708088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:38.716988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:38.763679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 823/1669] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:38.765515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.771809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:38.796418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 847/1670] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:38 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:38.800621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:38.817494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221d90e-fd53-4163-87b3-0ff1b1926fd8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:38.908485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:38.977574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:39.069741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742b182-7ede-4312-9b60-7c5439ca425b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:39.080539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:39.086055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:39.086908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:39.087507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] PATH_INFO: `/v3/projects/8210636bcb1c40bebb0342ccfc4e5015/users/bf329ce5fdd543f3bccedca450238804/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:39.135608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8210636bcb1c40bebb0342ccfc4e5015, user_id=bf329ce5fdd543f3bccedca450238804, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:39.139029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:39.145395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:39.146316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:39.147050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:39.147729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] PATH_INFO: `/v3/users/c50fa1f3fbce463d825d634ebc77f742` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:39.153822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50fa1f3fbce463d825d634ebc77f742)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:39.158322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:39.248991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 848/1671] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:38 2022] PUT /identity/v3/projects/8210636bcb1c40bebb0342ccfc4e5015/users/bf329ce5fdd543f3bccedca450238804/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:39.250728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:39.374856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50fa1f3fbce463d825d634ebc77f742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:39.405693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50fa1f3fbce463d825d634ebc77f742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:39.458681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50fa1f3fbce463d825d634ebc77f742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:39.467304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50fa1f3fbce463d825d634ebc77f742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:39.508053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccce702-8be1-41f7-a566-499375d3df6f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:39.529928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0afa8671-4910-4a2d-9957-74a71fffac08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50fa1f3fbce463d825d634ebc77f742'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:39.534187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:39.535650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:39.536165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:39.536630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:39.538015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:39.548957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 824/1672] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:38 2022] DELETE /identity/v3/users/c50fa1f3fbce463d825d634ebc77f742 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:39.555695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:39.556034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:39.556403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:39.568581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:39.606570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] MFA Rules not processed for user `bf329ce5fdd543f3bccedca450238804`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:39.608894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:39.645566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 849/1673] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:39 2022] POST /identity/v3/users => generated 288 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:39.647229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:39.660980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:39.711977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c869d75-6615-4ff2-92e0-aa228f4d9326 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:39.849052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 825/1674] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:39.850704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:39.856662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:39.910386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:39.911670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:39.912216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:39.912904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] PATH_INFO: `/v3/users/b5452ef297b1440788b808f4690a00fd` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:39.916649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5452ef297b1440788b808f4690a00fd)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:39.920099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.031317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:40.092525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5452ef297b1440788b808f4690a00fd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:40.119806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5452ef297b1440788b808f4690a00fd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:40.121834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5452ef297b1440788b808f4690a00fd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:40.158520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5452ef297b1440788b808f4690a00fd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:40.171137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5452ef297b1440788b808f4690a00fd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:40.184456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 850/1675] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:39 2022] DELETE /identity/v3/users/b5452ef297b1440788b808f4690a00fd => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:40.185849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:40.188241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:40.219535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:40.264563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db083d-d1ce-42fa-8c40-3e3a4190ac96 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.362135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85e241-9aaa-4fed-9147-2a0e8756e276 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.364144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb2025-98bd-407c-afc2-7eee8e24ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.365074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb2025-98bd-407c-afc2-7eee8e24ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.366146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb2025-98bd-407c-afc2-7eee8e24ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.366146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb2025-98bd-407c-afc2-7eee8e24ad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.367007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb2025-98bd-407c-afc2-7eee8e24ad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:40.369445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb2025-98bd-407c-afc2-7eee8e24ad4d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.376691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.378087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.378087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.378371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.378915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:40.381216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.382541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 826/1676] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:40.384188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.384586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.384960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.413580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:40.416297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:40.439615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 827/1677] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:40.441167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:40.443674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:40.460932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 851/1678] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:40 2022] POST /identity/v3/projects => generated 403 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:40.461873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:40.463580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfecd4-68da-44cd-bd7f-984545931d17 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.575174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.576341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.576801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.577287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.578244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:40.580339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.605811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 828/1679] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:40.610914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875c6c8-f603-44e2-821a-4d8057ac4fda admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.612833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:40.624538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.625279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.625947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.626230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.626982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:40.629686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.638531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af3a58-80b1-44b7-af22-7a0914bec67e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.650191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.652711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.654500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.655710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] PATH_INFO: `/v3/projects/737ba7372c324dfbaac1f9f889a371a8/users/b58d0a1729e54afd94225e1b0d00433c/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.674949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 852/1680] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:40 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:15:40.674949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:40.699509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad022c-f719-4399-8b6b-42f9324053cd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.703767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737ba7372c324dfbaac1f9f889a371a8, user_id=b58d0a1729e54afd94225e1b0d00433c, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:40.706799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.712172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6c7c5-73fa-4c50-9666-09ee3edcb593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.712628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c7c5-73fa-4c50-9666-09ee3edcb593 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.712923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c7c5-73fa-4c50-9666-09ee3edcb593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.713202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6c7c5-73fa-4c50-9666-09ee3edcb593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.714256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6c7c5-73fa-4c50-9666-09ee3edcb593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:40.715983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6c7c5-73fa-4c50-9666-09ee3edcb593 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:40.735950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 829/1681] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:40 2022] PUT /identity/v3/projects/737ba7372c324dfbaac1f9f889a371a8/users/b58d0a1729e54afd94225e1b0d00433c/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:40.738118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:40.740894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:40.751908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 853/1682] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:40.751908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d003e-bccc-4671-a837-9b2468ca3250 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.751908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d003e-bccc-4671-a837-9b2468ca3250 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.751908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d003e-bccc-4671-a837-9b2468ca3250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.810905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cb7d003e-bccc-4671-a837-9b2468ca3250 None None] MFA Rules not processed for user `728f1fbe76564467b378035d0d2d3be5`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:40.812232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cb7d003e-bccc-4671-a837-9b2468ca3250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:40.828863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:40.890732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d8407-e5e5-4d10-913f-352f09947fc7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:40.903158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:40.904445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:40.904445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:40.904445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:40.933764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:41.026885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 854/1683] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:41.029556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:41.029887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:41.030359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:41.036787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:41.038344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:41.067125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 830/1684] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:41.069707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:41.090669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6985880-4abf-4eac-abae-3267e4977401 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:41.106325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:41.107317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:41.107601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:41.108269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] PATH_INFO: `/v3/projects/72dbd03b811948ae84531305f8cf3367/users/b811a463cbda4836a3a5b7901d1bdc3b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:41.144201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dbd03b811948ae84531305f8cf3367, user_id=b811a463cbda4836a3a5b7901d1bdc3b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:41.147204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:41.156202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] MFA Rules not processed for user `b58d0a1729e54afd94225e1b0d00433c`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:41.158731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:41.177854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 831/1685] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:41 2022] PUT /identity/v3/projects/72dbd03b811948ae84531305f8cf3367/users/b811a463cbda4836a3a5b7901d1bdc3b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:41.182508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:41.183291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:41.386311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 855/1686] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:41.391180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:41.398784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906926a9-17eb-4232-8f47-754471db108d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:41.415270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:41.415968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:41.416255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:41.416595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:41.429143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5ac1-0467-4fcf-8101-de0a0b0dad65 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:41.566012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:41.567540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:41.595927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 832/1687] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:41.597432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:41.631925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:41.657238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:41.658306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:41.658589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:41.658918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:41.660577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:41.673277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:41.735052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 856/1688] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:41.740107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:41.748154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:41.789161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059b04-6c4c-490f-b35e-10f15045f130 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:41.807291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f24b8-36b5-4130-8780-8eece5505916 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:41.809747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:41.811488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:41.811488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:41.811673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:41.812789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:41.816162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:41.829527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:41.832232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:41.832527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:41.833418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] PATH_INFO: `/v3/projects/09d590c4a2ca4b33864e81dfe4d10785` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:41.838786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d590c4a2ca4b33864e81dfe4d10785)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:41.847953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:41.914587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 833/1689] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:41 2022] POST /identity/v3/projects => generated 377 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:41.915527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:41.991048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:42.063552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d590c4a2ca4b33864e81dfe4d10785', 'request_id': 'req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.082633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785c63c-0fe8-4a23-84f7-2d790c75c5a2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:42.094240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d590c4a2ca4b33864e81dfe4d10785', 'request_id': 'req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.125148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d590c4a2ca4b33864e81dfe4d10785', 'request_id': 'req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.199411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] The token cache is being invalidate because project 09d590c4a2ca4b33864e81dfe4d10785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:42.203004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.210142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.225965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 857/1690] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:41 2022] DELETE /identity/v3/projects/09d590c4a2ca4b33864e81dfe4d10785 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:42.228086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:42.235671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:42.250546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:42.251645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:42.251971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:42.252252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] PATH_INFO: `/v3/projects/72dbd03b811948ae84531305f8cf3367/users/b811a463cbda4836a3a5b7901d1bdc3b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:42.258806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72dbd03b811948ae84531305f8cf3367, user_id=b811a463cbda4836a3a5b7901d1bdc3b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:42.261735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:42.311209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 834/1691] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:41 2022] PUT /identity/v3/projects/72dbd03b811948ae84531305f8cf3367/users/b811a463cbda4836a3a5b7901d1bdc3b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:42.311209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:42.311585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca974-3ab7-40c5-9515-bb91bc2f9e24 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:42.311713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:42.423095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:42.470711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4783c1-55d7-4c50-a552-911c994b4348 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:42.488522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:42.488803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:42.489085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:42.489482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] PATH_INFO: `/v3/users/8d0993076a4f4e62b387cfaacc204a7d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:42.491871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0993076a4f4e62b387cfaacc204a7d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:42.493003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:42.557702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7ff22-10c7-45e7-bc86-7ab6da886066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:42.559764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ff22-10c7-45e7-bc86-7ab6da886066 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:42.560910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ff22-10c7-45e7-bc86-7ab6da886066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:42.560910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ff22-10c7-45e7-bc86-7ab6da886066 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:42.564715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7ff22-10c7-45e7-bc86-7ab6da886066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:42.571177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7ff22-10c7-45e7-bc86-7ab6da886066 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:42.628354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 858/1692] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:42 2022] POST /identity/v3/users => generated 295 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:42.634391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:42.635145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:42.635540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:42.641313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0993076a4f4e62b387cfaacc204a7d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.661902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0993076a4f4e62b387cfaacc204a7d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.676731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0993076a4f4e62b387cfaacc204a7d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.680357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0993076a4f4e62b387cfaacc204a7d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.725400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] MFA Rules not processed for user `b811a463cbda4836a3a5b7901d1bdc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:42.726817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:42.729666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0993076a4f4e62b387cfaacc204a7d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:42.752655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 835/1693] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:42 2022] DELETE /identity/v3/users/8d0993076a4f4e62b387cfaacc204a7d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:42.754186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:42.760366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:42.957805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906372c-3cf2-43f7-8ceb-c20b4aec7df6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:42.972351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:42.973150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:42.973470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:42.973748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:42.974526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:42.976306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:43.007546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 836/1694] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:43.010357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 859/1695] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:43.012020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:43.028524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38c835-f578-4aba-adcb-754b5a4e05d6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:43.031597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:43.033634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:43.055854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:43.056813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:43.057101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:43.057405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] PATH_INFO: `/v3/projects/fdc522d7295147f3b8f374349a1a7e95/users/f2ebbdd45573442aa7909abee051185b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:43.120852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc522d7295147f3b8f374349a1a7e95, user_id=f2ebbdd45573442aa7909abee051185b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:43.123690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:43.153777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:43.183371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 837/1696] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:43 2022] PUT /identity/v3/projects/fdc522d7295147f3b8f374349a1a7e95/users/f2ebbdd45573442aa7909abee051185b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:43.189927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:43.258553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1e081-8544-4824-952a-4314cfa960e6 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:43.330058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:43.399870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:43.400606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:43.400913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:43.401837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:43.410087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b500ff-02e5-465f-b697-0637558856f2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:43.424037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:43.424902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:43.425241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:43.430552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:43.431757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:43.438939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:43.474271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 838/1697] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:43.476592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:43.502900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdee1f9-671f-4cc1-ae43-34b56f01989c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:43.516965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833e00e-f5a0-4d2a-b049-bdd70a8733fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:43.519312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833e00e-f5a0-4d2a-b049-bdd70a8733fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:43.520626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833e00e-f5a0-4d2a-b049-bdd70a8733fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:43.520944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833e00e-f5a0-4d2a-b049-bdd70a8733fb admin admin] PATH_INFO: `/v3/projects/fdc522d7295147f3b8f374349a1a7e95/users/f2ebbdd45573442aa7909abee051185b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:43.527002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833e00e-f5a0-4d2a-b049-bdd70a8733fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc522d7295147f3b8f374349a1a7e95, user_id=f2ebbdd45573442aa7909abee051185b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:43.536503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833e00e-f5a0-4d2a-b049-bdd70a8733fb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:43.546603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:43.548808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:43.585368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 839/1698] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:43 2022] PUT /identity/v3/projects/fdc522d7295147f3b8f374349a1a7e95/users/f2ebbdd45573442aa7909abee051185b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:15:43.585937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 860/1699] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:43 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:15:43.596809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:43.597111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:43.597433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:43.696218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] MFA Rules not processed for user `f2ebbdd45573442aa7909abee051185b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:43.697165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:43.891385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:43.892969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:43.964064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d2a2-6a3f-41aa-a60b-bc345a71431e service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:44.092588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 840/1700] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:44.092588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:44.097426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:44.255984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:44.259203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:44.260125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:44.260748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] PATH_INFO: `/v3/projects/747de57511cf4f8a9e5b2503d7550c84` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:44.265376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=747de57511cf4f8a9e5b2503d7550c84)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:44.276028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:44.412840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:44.420956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd9c71-116a-407f-9616-b84e0d9f39da None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:44.437753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747de57511cf4f8a9e5b2503d7550c84', 'request_id': 'req-e5f3967a-f14e-46df-9c25-7b4db47de4bd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:44.467106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747de57511cf4f8a9e5b2503d7550c84', 'request_id': 'req-e5f3967a-f14e-46df-9c25-7b4db47de4bd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:44.486925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747de57511cf4f8a9e5b2503d7550c84', 'request_id': 'req-e5f3967a-f14e-46df-9c25-7b4db47de4bd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:44.542219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] The token cache is being invalidate because project 747de57511cf4f8a9e5b2503d7550c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:44.544773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:44.545847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:44.556708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 861/1701] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:43 2022] DELETE /identity/v3/projects/747de57511cf4f8a9e5b2503d7550c84 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:15:44.558005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:44.563649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:44.717632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:44.764661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:44.769845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:44.776000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:44.776000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] PATH_INFO: `/v3/users/bf329ce5fdd543f3bccedca450238804` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:44.782780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf329ce5fdd543f3bccedca450238804)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:44.794418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:44.889271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3967a-f14e-46df-9c25-7b4db47de4bd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:44.919408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:44.920991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:44.921688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:44.922039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:44.929063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:45.023382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf329ce5fdd543f3bccedca450238804'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.087563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf329ce5fdd543f3bccedca450238804'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.126030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf329ce5fdd543f3bccedca450238804'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.127774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf329ce5fdd543f3bccedca450238804'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.163650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-47109739-7b41-4966-bec4-72d81e6af0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf329ce5fdd543f3bccedca450238804'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.240417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 841/1702] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:44 2022] DELETE /identity/v3/users/bf329ce5fdd543f3bccedca450238804 => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:45.249073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:45.252435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:45.253253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:45.311532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:45.313835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:45.346874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:45.361798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d07de-6c7e-4d4b-9576-17b7170b7cf3 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:45.387533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 862/1703] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:45.410182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1dce-dc9f-4d57-ba65-74f356773bb3 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:45.410182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1dce-dc9f-4d57-ba65-74f356773bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:45.415101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba1dce-dc9f-4d57-ba65-74f356773bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:45.473189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b6ba1dce-dc9f-4d57-ba65-74f356773bb3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:45.473189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b6ba1dce-dc9f-4d57-ba65-74f356773bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:45.557673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 842/1704] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:45.560518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:45.567981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:45.616688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7d16-a2b9-425b-86c1-9ee899f58198 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:45.638084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:45.643974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:45.644307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:45.644894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] PATH_INFO: `/v3/projects/a689d5d1e6f64cd6afb4aad7a93cb38e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:45.653038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a689d5d1e6f64cd6afb4aad7a93cb38e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:45.660107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: WARNING py.warnings [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 22:15:45.660107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: warnings.warn(msg) Jun 15 22:15:45.660107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: Jun 15 22:15:45.670819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:45.728559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 863/1705] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:45.733624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:45.733914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:45.734199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:45.808871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:45.811129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:45.861573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 864/1706] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:45.863313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:45.891094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f9357-73d9-4b5f-8432-08a28817919f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:45.909182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a689d5d1e6f64cd6afb4aad7a93cb38e', 'request_id': 'req-707f0746-5c7c-44dc-83d5-9148b05d59a4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.946106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a689d5d1e6f64cd6afb4aad7a93cb38e', 'request_id': 'req-707f0746-5c7c-44dc-83d5-9148b05d59a4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.948230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:45.987146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a689d5d1e6f64cd6afb4aad7a93cb38e', 'request_id': 'req-707f0746-5c7c-44dc-83d5-9148b05d59a4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:45.995503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:46.015119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] The token cache is being invalidate because project a689d5d1e6f64cd6afb4aad7a93cb38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:46.015705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:46.019361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-707f0746-5c7c-44dc-83d5-9148b05d59a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:46.028458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 843/1707] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:45 2022] DELETE /identity/v3/projects/a689d5d1e6f64cd6afb4aad7a93cb38e => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:46.031612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff7e80-99e6-4375-9e3d-86855feb5a9e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.032145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff7e80-99e6-4375-9e3d-86855feb5a9e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.033134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff7e80-99e6-4375-9e3d-86855feb5a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.072901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-22ff7e80-99e6-4375-9e3d-86855feb5a9e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:46.075434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-22ff7e80-99e6-4375-9e3d-86855feb5a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.135683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:46.136415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.136819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.137082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.137963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:46.138290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:46.140140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:46.172269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 865/1708] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:46.176728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:46.179310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.252088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 844/1709] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:46.253447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b2cc-522e-4a6a-85d9-0364c9425a57 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.257667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b2cc-522e-4a6a-85d9-0364c9425a57 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.258081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479b2cc-522e-4a6a-85d9-0364c9425a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.362831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5479b2cc-522e-4a6a-85d9-0364c9425a57 None None] MFA Rules not processed for user `5fd1bd3a55de406d9f4b2adf35bef024`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:46.364409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5479b2cc-522e-4a6a-85d9-0364c9425a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.391451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41805cf-e0e2-4d69-bde7-188b741c7ca5 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:46.409984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:46.410685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.410996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.411299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.427317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.464554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:46.466089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:46.519196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 866/1710] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:46.519477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:46.524840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.557302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966fff1-c643-4a55-a8d3-c5f24881b9ae service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:46.597212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e0afe-611a-4b2b-9f67-3fc3fa9802b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:46.598021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0afe-611a-4b2b-9f67-3fc3fa9802b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.598311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0afe-611a-4b2b-9f67-3fc3fa9802b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.598593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e0afe-611a-4b2b-9f67-3fc3fa9802b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.599343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e0afe-611a-4b2b-9f67-3fc3fa9802b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:46.614775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e0afe-611a-4b2b-9f67-3fc3fa9802b8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:46.631278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 845/1711] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:46.645120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.645473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.645756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.711336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 867/1712] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:46 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:46.716679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.716973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.717252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.717767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:46.719306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.758559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] MFA Rules not processed for user `5fd1bd3a55de406d9f4b2adf35bef024`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:46.759824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:46.919303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 846/1713] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:46.920208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:46.939904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b415ad-47ea-4631-a4ba-8caa11f36de0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:46.953959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 868/1714] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:46.962861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:46.966663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:46.967483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:46.967766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:46.968043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:46.968789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:46.971044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:47.000821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25bcaf-8a0b-4c13-9c8d-bbcb805fd4c2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:47.016849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:47.018138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:47.028195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:47.028407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:47.029172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:47.029538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:47.031445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:47.047272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 847/1715] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:46 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:47.051478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:47.064645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:47.086679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 869/1716] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:47.089140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:47.094077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:47.125548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e64b2b-6482-434e-85ab-0cc0c52c90ad admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:47.134462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:47.135748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:47.136136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:47.137028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:47.147385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:47.151628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:47.200355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 870/1717] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:47.201439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:47.214924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e88b1-78b4-49a0-b8ee-3ca52113a946 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:47.220296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e9101-3cda-49d6-8c93-a528677e81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:47.220997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9101-3cda-49d6-8c93-a528677e81f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:47.221401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9101-3cda-49d6-8c93-a528677e81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:47.221681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9101-3cda-49d6-8c93-a528677e81f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:47.223055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e9101-3cda-49d6-8c93-a528677e81f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:47.225592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e9101-3cda-49d6-8c93-a528677e81f5 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:47.231574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:47.284367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 871/1718] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:47 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:47.289914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:47.290339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:47.290780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:47.298743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46d30c-39be-4bb6-a47d-104715aa4466 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:47.377005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] MFA Rules not processed for user `c10fe54c24554b4db6783014a85cfa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:47.377832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:47.527305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:47.528039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:47.531243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:47.531898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:47.654086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 872/1719] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:47.655092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:47.750388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:47.752129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:47.785074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 848/1720] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:47.786091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:47.825961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c95db-5151-4d75-9638-e835278e295f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:47.846218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:47.847868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:47.848049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:47.848333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:47.849116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:47.851005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:47.906449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 873/1721] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:47.907853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:47.920508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:47.975673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca5efa-39af-426e-b7e4-ee3e315d3e27 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:47.983776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:48.003598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:48.004520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.004520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.004799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.044689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:48.046599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:48.068673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4dee-1638-45fc-90ce-735749d26ec6 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:48.078780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:48.083856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.084508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.084906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.087834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:48.089186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 874/1722] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:48.089872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:48.090076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:48.127315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 849/1723] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:47 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:48.130247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:48.144129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f86281-a3db-444c-be5a-b58e24bc2293 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:48.167851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ad86b-c0bd-4207-975c-56c16b8ec235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:48.168959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ad86b-c0bd-4207-975c-56c16b8ec235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.169277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ad86b-c0bd-4207-975c-56c16b8ec235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.169621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ad86b-c0bd-4207-975c-56c16b8ec235 admin admin] PATH_INFO: `/v3/projects/ccfdbb7ade6d43489315f90d549f1a72/users/37789c7ad2ba466398a003562348647a/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.174315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1047-4997-4bf9-8aff-042020fb0bfa admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:48.183335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:48.184216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.184559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.184905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.185948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:48.187993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:48.223059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 850/1724] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:48.227996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:48.237232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ad86b-c0bd-4207-975c-56c16b8ec235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfdbb7ade6d43489315f90d549f1a72, user_id=37789c7ad2ba466398a003562348647a, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:48.244603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ad86b-c0bd-4207-975c-56c16b8ec235 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:48.273726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34a79-9b26-4200-9b61-3a27ebf987e7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:48.299727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:48.302200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.307562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.310067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.311753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 875/1725] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:48 2022] PUT /identity/v3/projects/ccfdbb7ade6d43489315f90d549f1a72/users/37789c7ad2ba466398a003562348647a/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:48.312328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:48.313297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.313703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.313932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.320483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:48.373466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 851/1726] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:48.380408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:48.415849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988835e-ce6d-4c72-a451-a5cb337ba07b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:48.443275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] MFA Rules not processed for user `37789c7ad2ba466398a003562348647a`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:48.444679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:48.537132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:48.679355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 876/1727] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:48.692098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05843-6c78-49f0-be49-4e64cdf32aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:48.694577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05843-6c78-49f0-be49-4e64cdf32aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.695622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05843-6c78-49f0-be49-4e64cdf32aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.696411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05843-6c78-49f0-be49-4e64cdf32aeb admin admin] PATH_INFO: `/v3/projects/8079759be7c9436da696d955d0eafaba/users/f70d7f6f7b074548aebd70f70208da15/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:48.716413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:48.767324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da05843-6c78-49f0-be49-4e64cdf32aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8079759be7c9436da696d955d0eafaba, user_id=f70d7f6f7b074548aebd70f70208da15, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:48.788947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da05843-6c78-49f0-be49-4e64cdf32aeb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:48.905402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 852/1728] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:48 2022] PUT /identity/v3/projects/8079759be7c9436da696d955d0eafaba/users/f70d7f6f7b074548aebd70f70208da15/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:48.929038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:48.937579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:48.942828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:49.076709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] MFA Rules not processed for user `f70d7f6f7b074548aebd70f70208da15`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:49.079269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:49.481650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 853/1729] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 576 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:49.488776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:49.579413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0647b41-b65d-4810-bef9-4a334f1739af None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:49.667216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:49.910628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8866e-3b06-4cc5-a11b-3024698854ff None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:49.953086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:49.954669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:49.955052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:49.955555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:49.968209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:49.973551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:49.974416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:49.974912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:49.990317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:50.005818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:50.151417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 854/1730] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:49 2022] POST /identity/v3/projects => generated 385 bytes in 665 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:50.156647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:50.168903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:50.310088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:50.316870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:50.349121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:50.380912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 877/1731] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 1665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:15:50.395661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:50.486806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41c55e-5f44-4b6d-8d0d-b1d722503888 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:50.670749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1bdf6-576b-401b-aa58-17c2227ffa21 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:50.700964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:50.705845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:50.707373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:50.708861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] PATH_INFO: `/v3/projects/8210636bcb1c40bebb0342ccfc4e5015` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:50.714578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8210636bcb1c40bebb0342ccfc4e5015)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:50.724724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:50.897619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f6cdd-552b-49b2-8f08-6d33a3546425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:50.900464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6cdd-552b-49b2-8f08-6d33a3546425 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:50.900940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6cdd-552b-49b2-8f08-6d33a3546425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:50.901476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f6cdd-552b-49b2-8f08-6d33a3546425 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:50.907821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6cdd-552b-49b2-8f08-6d33a3546425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:50.917841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f6cdd-552b-49b2-8f08-6d33a3546425 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:51.017203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 878/1732] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:50 2022] POST /identity/v3/users => generated 293 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:51.020257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8210636bcb1c40bebb0342ccfc4e5015', 'request_id': 'req-b0b7731d-fe36-43c4-816d-cf62b3ef5337'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.027133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af9ff7-443d-4def-bf01-5bfbce448b5a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:51.027454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af9ff7-443d-4def-bf01-5bfbce448b5a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:51.028393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af9ff7-443d-4def-bf01-5bfbce448b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:51.065153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8210636bcb1c40bebb0342ccfc4e5015', 'request_id': 'req-b0b7731d-fe36-43c4-816d-cf62b3ef5337'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.089882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8210636bcb1c40bebb0342ccfc4e5015', 'request_id': 'req-b0b7731d-fe36-43c4-816d-cf62b3ef5337'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.155112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] The token cache is being invalidate because project 8210636bcb1c40bebb0342ccfc4e5015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:51.155112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.166015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.166015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 855/1733] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:50 2022] DELETE /identity/v3/projects/8210636bcb1c40bebb0342ccfc4e5015 => generated 0 bytes in 1010 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:51.172275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:51.192963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:51.202644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b0af9ff7-443d-4def-bf01-5bfbce448b5a None None] MFA Rules not processed for user `9be9445fdbc4459da4feb7c0bc1b310f`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:51.205477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b0af9ff7-443d-4def-bf01-5bfbce448b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:51.356017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:51.444687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 879/1734] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:51.446799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4c48-2869-4054-bc9b-583d39853c23 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:51.446799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4c48-2869-4054-bc9b-583d39853c23 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:51.447057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4c48-2869-4054-bc9b-583d39853c23 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:51.449565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 880/1735] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 15 22:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:51.450439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4c48-2869-4054-bc9b-583d39853c23 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:51.452635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7eac4c48-2869-4054-bc9b-583d39853c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:51.462636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7731d-fe36-43c4-816d-cf62b3ef5337 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:51.473460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4c48-2869-4054-bc9b-583d39853c23 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:51.480522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:51.481773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:51.482137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:51.482351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] PATH_INFO: `/v3/users/b811a463cbda4836a3a5b7901d1bdc3b` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:51.482469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:51.483756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b811a463cbda4836a3a5b7901d1bdc3b)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:51.486887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:51.487379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:51.487506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:51.488026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:51.490852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:51.498092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:51.531242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 856/1736] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:51.533355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:51.542373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:51.594867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52a47-0bbe-46e5-8bda-f22282b69fec admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:51.617311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:51.619559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:51.620055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:51.620507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] PATH_INFO: `/v3/users/37789c7ad2ba466398a003562348647a` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:51.625345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37789c7ad2ba466398a003562348647a)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:51.641026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:51.643464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b811a463cbda4836a3a5b7901d1bdc3b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.666056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b811a463cbda4836a3a5b7901d1bdc3b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.670137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b811a463cbda4836a3a5b7901d1bdc3b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.725621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b811a463cbda4836a3a5b7901d1bdc3b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.737255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:51.762587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c55f4d6f-2c61-47de-9bfc-4917c58d90f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b811a463cbda4836a3a5b7901d1bdc3b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.798841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 881/1737] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:51 2022] DELETE /identity/v3/users/b811a463cbda4836a3a5b7901d1bdc3b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:51.806666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:51.808678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:51.808866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:51.841853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37789c7ad2ba466398a003562348647a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.871059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37789c7ad2ba466398a003562348647a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.912493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] MFA Rules not processed for user `9be9445fdbc4459da4feb7c0bc1b310f`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:51.919449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:51.927236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37789c7ad2ba466398a003562348647a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:51.930450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37789c7ad2ba466398a003562348647a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:52.013499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bfc11a04-fec6-445c-9d1c-2f4ea2856305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37789c7ad2ba466398a003562348647a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:52.044400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 857/1738] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:15:51 2022] DELETE /identity/v3/users/37789c7ad2ba466398a003562348647a => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:52.055072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f253e50-bc9d-497a-b5bf-5c3eff642837 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:52.057448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f253e50-bc9d-497a-b5bf-5c3eff642837 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:52.057448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f253e50-bc9d-497a-b5bf-5c3eff642837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:52.230333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 882/1739] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:52.230333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:52.234907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4f253e50-bc9d-497a-b5bf-5c3eff642837 None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:52.238578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f253e50-bc9d-497a-b5bf-5c3eff642837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:52.241401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:52.571019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 858/1740] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:52.575277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:52.576245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:52.576813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:52.649086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c638d06-578f-4364-bdd2-77435203cf41 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:52.664496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] MFA Rules not processed for user `728f1fbe76564467b378035d0d2d3be5`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:52.666846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:52.765524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:52.835237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 859/1741] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:52.836578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:52.843967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:52.882011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe219d-7a5e-42ea-af22-f2fbd5b5ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:52.883162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe219d-7a5e-42ea-af22-f2fbd5b5ddef admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:52.883676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe219d-7a5e-42ea-af22-f2fbd5b5ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:52.884492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe219d-7a5e-42ea-af22-f2fbd5b5ddef admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:52.885824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe219d-7a5e-42ea-af22-f2fbd5b5ddef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:52.889790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe219d-7a5e-42ea-af22-f2fbd5b5ddef admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:52.938366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 883/1742] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 709 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:52.941208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:52.941446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:52.941886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:52.982294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:52.985420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:53.030310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 884/1743] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:53.033536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:53.040528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:53.124238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:53.183311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe707b1-3c18-4f11-bfa6-97e09ccbc325 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:53.202515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:53.203780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:53.205215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:53.223460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:53.231399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:53.249631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c556df-8598-40c6-a338-c9fec8faa2fb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:53.275053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:53.276402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:53.277040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:53.277694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:53.288487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:53.578119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:53.585719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:53.616804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 885/1744] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:53.620787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:53.628913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:53.634209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:53.635712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:53.659654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd81fc-fe16-4f90-b9d6-2f2a42333819 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:53.680717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:53.682451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:53.683661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:53.684927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:53.688690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 860/1745] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:53.689898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:53.698754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:53.729483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:53.730979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:53.750827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbff8-bedc-40ab-a59c-81ddef26a5f6 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:53.762725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:53.763653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:53.763939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:53.764264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] PATH_INFO: `/v3/projects/72dbd03b811948ae84531305f8cf3367` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:53.766584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72dbd03b811948ae84531305f8cf3367)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:53.768744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:53.772404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 886/1746] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:53.775391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:53.825720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681a78c-d172-4c50-9b54-4998f8b2e7c8 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:53.842608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:53.845569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:53.846778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:53.847763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] PATH_INFO: `/v3/projects/9c8d90c8c01044cdb5004c1090f21baa/users/af78cf8d120b415598f85fded16fc290/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:53.900888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72dbd03b811948ae84531305f8cf3367', 'request_id': 'req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:53.929950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72dbd03b811948ae84531305f8cf3367', 'request_id': 'req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:53.948640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8d90c8c01044cdb5004c1090f21baa, user_id=af78cf8d120b415598f85fded16fc290, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:53.954309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72dbd03b811948ae84531305f8cf3367', 'request_id': 'req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:53.956440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:54.002675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] The token cache is being invalidate because project 72dbd03b811948ae84531305f8cf3367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:54.004044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:54.004628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cfa4ae4-8df2-40dd-98bd-8542e2ee5677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:54.016323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 887/1747] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:53 2022] PUT /identity/v3/projects/9c8d90c8c01044cdb5004c1090f21baa/users/af78cf8d120b415598f85fded16fc290/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:54.016660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 861/1748] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:53 2022] DELETE /identity/v3/projects/72dbd03b811948ae84531305f8cf3367 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:54.019626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:54.024246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085617ab-cb89-41d3-8e0a-57771b22f620 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.024760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085617ab-cb89-41d3-8e0a-57771b22f620 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.025248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085617ab-cb89-41d3-8e0a-57771b22f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.035435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:54.105355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-085617ab-cb89-41d3-8e0a-57771b22f620 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:54.107318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-085617ab-cb89-41d3-8e0a-57771b22f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:54.181777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:54.250042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9ce96-340e-40e3-8a7b-4c19f4a15404 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:54.255674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:54.256389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.256734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.257019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.274525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:54.372907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 862/1749] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:15:54.374708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.374999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.375278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.430213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] MFA Rules not processed for user `af78cf8d120b415598f85fded16fc290`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:54.431834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:54.434615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:54.498273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:54.510145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c2b5-f449-485e-a2eb-0932ae7e1e1c service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:54.541953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 888/1750] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:54.546062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.546698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.547164 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.590447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:54.592755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:54.645066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 889/1751] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:54.651557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:54.682804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 863/1752] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:54.688133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:54.694010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:54.695939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c22c41-f23a-4814-a118-7f0cd55c3fe9 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:54.723937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:54.726414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.726835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.727309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.730988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:54.732777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:54.740440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:54.780627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698f919-c27f-49d9-9dfb-8348872510d9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:54.829162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:54.839554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.840155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.843220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.844721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:54.860357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 890/1753] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:54.862821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:54.864955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:54.921908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf470762-217d-44c4-af99-5b32fa94154a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:54.941667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:54.941667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:54.941667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:54.941667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:54.942268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:54.942268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:54.956803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 864/1754] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:54 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:54.963314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.134670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 891/1755] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:54 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:55.136628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.233822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837bac-3a7f-4053-9692-c7a97ce01549 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.428076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:55.474829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf52e-e2b1-4994-a86c-036357f766ce admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.489413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.490900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.491547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.492229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.494007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.498603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.500493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.502398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.504802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.505772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.507660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.513386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.560888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 892/1756] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:55 2022] POST /identity/v3/users => generated 293 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:15:55.562034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.571302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:55.585226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 865/1757] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:54 2022] POST /identity/v3/users => generated 300 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:55.590549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.624913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf6f39-86a4-4cda-89a9-74cac265c3a5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.630576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.631418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.631733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.632723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.632723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.634939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.652398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 866/1758] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:55.653645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.672261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bbfa4-88ea-4e43-b8ab-0f12c3f602d3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.680028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.681097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.682454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.682940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.683891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.685854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.704928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 867/1759] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:55.707484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.723798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39147a1-2284-49b9-9da3-d790000ef615 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.738987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f952b-757f-452e-bd6a-bb111e0f9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.742184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f952b-757f-452e-bd6a-bb111e0f9cca admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.742992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f952b-757f-452e-bd6a-bb111e0f9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.744698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f952b-757f-452e-bd6a-bb111e0f9cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.745734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f952b-757f-452e-bd6a-bb111e0f9cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.753598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f952b-757f-452e-bd6a-bb111e0f9cca admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.799549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 868/1760] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:55.808217 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd8c95-0d6c-43b5-8dc5-d543196c1cb4 None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.808937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd8c95-0d6c-43b5-8dc5-d543196c1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.810015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd8c95-0d6c-43b5-8dc5-d543196c1cb4 None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.819716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 869/1761] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jun 15 22:15:55 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:15:55.821527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd8c95-0d6c-43b5-8dc5-d543196c1cb4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.849947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a7921-5f1f-42d1-aa18-126f21fdb8ee admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.872855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd8c95-0d6c-43b5-8dc5-d543196c1cb4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:55.873171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.874280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.874661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.875228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.884291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:55.888506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159ad8-3a34-4e47-88a5-03de3b9bea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:55.890530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159ad8-3a34-4e47-88a5-03de3b9bea8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:55.891216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159ad8-3a34-4e47-88a5-03de3b9bea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:55.891876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159ad8-3a34-4e47-88a5-03de3b9bea8d admin admin] PATH_INFO: `/v3/projects/8775e230cefa4b1ebe70605abc34ec86/users/a5b5c4c8bdaf46c4b19996d90120aef0/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:55.943593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.944196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159ad8-3a34-4e47-88a5-03de3b9bea8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8775e230cefa4b1ebe70605abc34ec86, user_id=a5b5c4c8bdaf46c4b19996d90120aef0, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:55.945413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.955920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159ad8-3a34-4e47-88a5-03de3b9bea8d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:55.968860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 893/1762] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:55.969864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:55.997759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309deec2-49d3-45c7-af12-7ca9287002ae service placement] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:56.012770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 870/1763] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:55 2022] PUT /identity/v3/projects/8775e230cefa4b1ebe70605abc34ec86/users/a5b5c4c8bdaf46c4b19996d90120aef0/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:56.014675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a4324-232a-4886-8ded-3c4ca0291013 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.015135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a4324-232a-4886-8ded-3c4ca0291013 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.015617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a4324-232a-4886-8ded-3c4ca0291013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.050162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:56.052679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fb9a4324-232a-4886-8ded-3c4ca0291013 None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:56.057357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fb9a4324-232a-4886-8ded-3c4ca0291013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:56.153309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:56.154537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.155558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.155854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] PATH_INFO: `/v3/projects/3816c4e9fab2402ab5e19e1c086511fc/users/e76dab79a70447538dedbb3294e4f1b3/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.188160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3816c4e9fab2402ab5e19e1c086511fc, user_id=e76dab79a70447538dedbb3294e4f1b3, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:56.194327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:56.228335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 894/1764] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:55 2022] PUT /identity/v3/projects/3816c4e9fab2402ab5e19e1c086511fc/users/e76dab79a70447538dedbb3294e4f1b3/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:56.230953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:56.258372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 871/1765] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:15:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:56.262639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81befaf5-4cc5-4b94-a107-30055dcc8c25 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.262639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81befaf5-4cc5-4b94-a107-30055dcc8c25 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.262639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81befaf5-4cc5-4b94-a107-30055dcc8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.285398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-81befaf5-4cc5-4b94-a107-30055dcc8c25 None None] MFA Rules not processed for user `c10fe54c24554b4db6783014a85cfa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:56.286778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-81befaf5-4cc5-4b94-a107-30055dcc8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:56.373954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a9fc5-db6a-4baf-8dda-02c3bdfca935 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:56.387629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:56.388424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.389484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.390021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.391312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 872/1766] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:56.392233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:56.393196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.393952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.394329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.394547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:56.422828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 895/1767] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:56.423760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:56.427006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:56.451268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] MFA Rules not processed for user `e76dab79a70447538dedbb3294e4f1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:56.452879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:56.480892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:56.532276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c848e-cf2e-4328-bb4d-bd60563684c5 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:56.547533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:56.548507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.551151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.551624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.575739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:56.581493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:56.605168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 896/1768] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:56.606315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 873/1769] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:56.609228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:56.612957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:56.615922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:56.643516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641e8ff-4bb1-475b-ba30-5d99ed5ee0af service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:56.648953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:56.649953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.650249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.650554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] PATH_INFO: `/v3/projects/ccfdbb7ade6d43489315f90d549f1a72` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.651728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a548-d277-41ec-8418-f86021ea7b60 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:56.652141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfdbb7ade6d43489315f90d549f1a72)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:56.654383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:56.674783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:56.676590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.677048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.677540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] PATH_INFO: `/v3/projects/8775e230cefa4b1ebe70605abc34ec86/users/a5b5c4c8bdaf46c4b19996d90120aef0/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.689950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8775e230cefa4b1ebe70605abc34ec86, user_id=a5b5c4c8bdaf46c4b19996d90120aef0, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:56.696942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:56.731116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:56.731509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 874/1770] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:56 2022] PUT /identity/v3/projects/8775e230cefa4b1ebe70605abc34ec86/users/a5b5c4c8bdaf46c4b19996d90120aef0/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:56.733013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:56.773831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfdbb7ade6d43489315f90d549f1a72', 'request_id': 'req-3b91c2e1-189e-4b60-96c0-7287fb97886e'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:56.789009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfdbb7ade6d43489315f90d549f1a72', 'request_id': 'req-3b91c2e1-189e-4b60-96c0-7287fb97886e'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:56.805607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfdbb7ade6d43489315f90d549f1a72', 'request_id': 'req-3b91c2e1-189e-4b60-96c0-7287fb97886e'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:56.830466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] The token cache is being invalidate because project ccfdbb7ade6d43489315f90d549f1a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:15:56.833184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:56.834835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3b91c2e1-189e-4b60-96c0-7287fb97886e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:15:56.840828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 897/1771] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:15:56 2022] DELETE /identity/v3/projects/ccfdbb7ade6d43489315f90d549f1a72 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:56.841295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48fd5-efef-48f1-ad9b-dfc9194c879e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:56.841646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48fd5-efef-48f1-ad9b-dfc9194c879e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:56.841926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48fd5-efef-48f1-ad9b-dfc9194c879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:56.936646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a5d48fd5-efef-48f1-ad9b-dfc9194c879e None None] MFA Rules not processed for user `a5b5c4c8bdaf46c4b19996d90120aef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:56.940419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a5d48fd5-efef-48f1-ad9b-dfc9194c879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:57.176146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aa236-1ac0-45a6-a65d-249bb3975315 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:57.206797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:57.207530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:57.216692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:57.218589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:57.225359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:57.240553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:57.366952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 898/1772] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:57.370465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:57.370956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:57.371525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:57.391529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 875/1773] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:56 2022] POST /identity/v3/projects => generated 387 bytes in 657 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:57.395902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:57.401751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:57.414453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:57.416822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:57.712991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc8efc-7ab4-42b7-bc99-26edb137ce40 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:57.729417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 899/1774] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:57.734298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:57.742800 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:57.743449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:57.746432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:57.746711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:57.746991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:57.805002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666deb70-eb00-4cf1-9fe6-5f8ca750ddea None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:57.847261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d43c1-2135-4d66-8cde-7072deab95e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:57.850100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d43c1-2135-4d66-8cde-7072deab95e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:57.857585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d43c1-2135-4d66-8cde-7072deab95e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:57.863977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d43c1-2135-4d66-8cde-7072deab95e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:57.868793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d43c1-2135-4d66-8cde-7072deab95e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:57.871842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d43c1-2135-4d66-8cde-7072deab95e8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:57.953985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 900/1775] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:57 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:57.954660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:57.955027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:57.955309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.009418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:58.027449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:58.031738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:58.055143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.056639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:58.075403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 876/1776] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:15:58.076429 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.088651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 901/1777] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:58.090290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.099119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb570-c56d-403b-9612-8eb6c32ab441 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.106615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:58.107532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:58.107817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:58.109152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.110074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.112701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:58.117487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cd760-e287-469c-af23-54fdbe0553cc None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.141473 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:58.142563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:58.143071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:58.143720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.144935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:15:58.147511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.149704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:58.151228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 877/1778] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:58.155811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.190959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ea455-034a-4356-b126-d10afec71444 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.217664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:58.220235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:58.221297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:58.221649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] PATH_INFO: `/v3/projects/768790c6990f47f49296796eb42bb3b8/users/98d67b83b49544b789c4b9080dcf0dd9/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.222919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 902/1779] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:15:58.227910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.244190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fc18a-8b6d-43a1-a4f2-11aca2e712ed admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.250564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:58.251429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:58.251837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:58.252331 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.253380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.255683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:58.292802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768790c6990f47f49296796eb42bb3b8, user_id=98d67b83b49544b789c4b9080dcf0dd9, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.293064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:58.301306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:58.349459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 878/1780] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:58 2022] PUT /identity/v3/projects/768790c6990f47f49296796eb42bb3b8/users/98d67b83b49544b789c4b9080dcf0dd9/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:58.351132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.370793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 903/1781] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:15:58 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:15:58.372785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.594685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8a8ce-0408-43f9-86d2-d7c9e2e86c56 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.738558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba239ac4-290a-408e-b522-6ede7b090a8a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.752793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:58.766712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:58.767383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:58.767787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.769169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.774704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:58.867439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 904/1782] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:15:58 2022] POST /identity/v3/users => generated 287 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:15:58.869636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:58.887249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0089-7adb-4993-afb7-74f4646f50a0 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:58.922678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122784-67aa-4cc2-8dd1-635a5144261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:58.923535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122784-67aa-4cc2-8dd1-635a5144261e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:58.925445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122784-67aa-4cc2-8dd1-635a5144261e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:58.925746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122784-67aa-4cc2-8dd1-635a5144261e admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:58.928258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122784-67aa-4cc2-8dd1-635a5144261e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:58.935963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122784-67aa-4cc2-8dd1-635a5144261e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:59.010041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 905/1783] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:59.014276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:59.014606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:59.015020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:59.031082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:59.031907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:59.032266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:59.032745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:59.046952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:59.061398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:59.088311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] MFA Rules not processed for user `9be9445fdbc4459da4feb7c0bc1b310f`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:59.092524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:59.147815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 879/1784] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 798 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:15:59.157956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:59.248198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b20c-1e35-431c-ac0f-df7cfa781611 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:59.284902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:59.285738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:59.286027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:59.293751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:59.294902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:59.307546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:59.357407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 880/1785] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:15:59.358660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:59.409958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a2cf7-2df8-4cf4-8ed4-b899c2647cc9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:59.432335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 906/1786] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:59.434305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf3907-b9a7-4b1d-a618-640c31f8ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:59.435248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3907-b9a7-4b1d-a618-640c31f8ec03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:59.435525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3907-b9a7-4b1d-a618-640c31f8ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:59.435871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf3907-b9a7-4b1d-a618-640c31f8ec03 admin admin] PATH_INFO: `/v3/projects/768790c6990f47f49296796eb42bb3b8/users/98d67b83b49544b789c4b9080dcf0dd9/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:59.439010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:59.446829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3907-b9a7-4b1d-a618-640c31f8ec03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768790c6990f47f49296796eb42bb3b8, user_id=98d67b83b49544b789c4b9080dcf0dd9, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:59.456816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf3907-b9a7-4b1d-a618-640c31f8ec03 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:59.488827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3346-84d0-4614-aabf-cd6d62ffb625 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:15:59.518808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 881/1787] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:59 2022] PUT /identity/v3/projects/768790c6990f47f49296796eb42bb3b8/users/98d67b83b49544b789c4b9080dcf0dd9/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:15:59.535843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:59.535843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:59.536095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:59.675386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] MFA Rules not processed for user `98d67b83b49544b789c4b9080dcf0dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:15:59.695887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:15:59.716734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:15:59.776822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:15:59.782974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:15:59.783303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:15:59.786002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] PATH_INFO: `/v3/projects/2c6c3a05eb0a4e60bb8cdadfeae7ecf0/users/a7254b0ceb27442083110bc34796c148/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:15:59.902236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6c3a05eb0a4e60bb8cdadfeae7ecf0, user_id=a7254b0ceb27442083110bc34796c148, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:15:59.935178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 882/1788] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:15:59.936325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:15:59.942766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:15:59.978471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:00.017787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 907/1789] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:15:59 2022] PUT /identity/v3/projects/2c6c3a05eb0a4e60bb8cdadfeae7ecf0/users/a7254b0ceb27442083110bc34796c148/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:00.020502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:00.032154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:00.179271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e06b7d-1257-4e68-92cb-1af9cb22e77c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:00.318479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:00.319368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:00.319657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:00.320058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:00.322080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:00.330400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e2895-9b52-40b1-a5f1-afe4c416a35a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:00.347321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:00.348771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:00.349570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:00.353605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:00.587473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:00.589681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8d623-5bfa-464d-8443-0ba4d3906b73 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:00.604281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 883/1790] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:15:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:00.622549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:00.624917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:00.628163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:00.679510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:00.682358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:00.714048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:00.722399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] MFA Rules not processed for user `a7254b0ceb27442083110bc34796c148`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:00.727469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:00.742167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 908/1791] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:01.023689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:01.024361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 884/1792] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:01.071019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:01.409925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41919e00-db8d-4681-a6de-b22785066ba1 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:01.415959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c02f0-130e-4f91-84b5-8c5a11a769f8 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:01.427442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:01.432200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288d671-e1c4-491e-8265-5fdf96d6e16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:01.433643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:01.434609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288d671-e1c4-491e-8265-5fdf96d6e16d admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:01.435480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:01.438048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] PATH_INFO: `/v3/users/e76dab79a70447538dedbb3294e4f1b3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:01.438845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288d671-e1c4-491e-8265-5fdf96d6e16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:01.440704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288d671-e1c4-491e-8265-5fdf96d6e16d admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:01.441712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288d671-e1c4-491e-8265-5fdf96d6e16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:01.443955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76dab79a70447538dedbb3294e4f1b3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:01.448572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:01.452161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288d671-e1c4-491e-8265-5fdf96d6e16d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:01.645130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76dab79a70447538dedbb3294e4f1b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:01.682425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76dab79a70447538dedbb3294e4f1b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:01.682761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 909/1793] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:01 2022] POST /identity/v3/projects => generated 373 bytes in 660 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:01.688621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38de5-e9fb-4ab0-a7c8-2b0534a19d6d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:01.688914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38de5-e9fb-4ab0-a7c8-2b0534a19d6d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:01.694890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38de5-e9fb-4ab0-a7c8-2b0534a19d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:01.717822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76dab79a70447538dedbb3294e4f1b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:01.724151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76dab79a70447538dedbb3294e4f1b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:01.773227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-52f38de5-e9fb-4ab0-a7c8-2b0534a19d6d None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:01.779716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-52f38de5-e9fb-4ab0-a7c8-2b0534a19d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:01.802482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76dab79a70447538dedbb3294e4f1b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:01.831592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 885/1794] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:01 2022] DELETE /identity/v3/users/e76dab79a70447538dedbb3294e4f1b3 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:01.832728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:01.840179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:01.921540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:01.936572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:02.075667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068ec53-b4c2-499f-992f-8da5f99dee6f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:02.107273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:02.108290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:02.108580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:02.108959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:02.117161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:02.138291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 910/1795] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:02.140351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:02.141552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:02.142083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:02.142548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:02.240107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 886/1796] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:01 2022] POST /identity/v3/users => generated 293 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:02.241688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:02.252795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:02.254986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:02.285931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0da66-e0d7-4fdc-a63a-e102edf23ba2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:02.306753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:02.307567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:02.307923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:02.308303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:02.309150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:02.315770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:02.334148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 911/1797] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:02.351584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 887/1798] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:02.351798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:02.384574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d861a-e6f6-4e32-b30d-fce8161cc428 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:02.404557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:02.406445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:02.411491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:02.417028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] PATH_INFO: `/v3/projects/4bd6f995e50741fbba1101e6f343effa/users/4b8d9dce157a4f3cbfa1a7295704a4c0/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:02.463558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd6f995e50741fbba1101e6f343effa, user_id=4b8d9dce157a4f3cbfa1a7295704a4c0, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:02.468313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:02.476974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:02.480723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:02.535024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 912/1799] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:02 2022] PUT /identity/v3/projects/4bd6f995e50741fbba1101e6f343effa/users/4b8d9dce157a4f3cbfa1a7295704a4c0/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:02.541209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:02.719208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea71f9-c87b-4aff-b96d-6c3ea4499db9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:02.767561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab61632-d848-469a-8774-a5ae5bb7b3ff admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:02.796842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:02.801166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:02.803467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:02.804879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:02.806254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:02.811278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:02.875743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:02.878584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 913/1800] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:02.879295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:02.881083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:02.881609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:02.882084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:02.885922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:02.917109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:02.919752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:02.990830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 888/1801] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:02.992697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:03.047925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93109fca-b40c-4ab4-bed8-9c191d8ed7ca service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:03.081480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4bedd-5fa4-44d4-89bd-e52f5196d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:03.083075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4bedd-5fa4-44d4-89bd-e52f5196d753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:03.083532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4bedd-5fa4-44d4-89bd-e52f5196d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:03.084003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4bedd-5fa4-44d4-89bd-e52f5196d753 admin admin] PATH_INFO: `/v3/projects/4bd6f995e50741fbba1101e6f343effa/users/4b8d9dce157a4f3cbfa1a7295704a4c0/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:03.102047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4bedd-5fa4-44d4-89bd-e52f5196d753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd6f995e50741fbba1101e6f343effa, user_id=4b8d9dce157a4f3cbfa1a7295704a4c0, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:03.107463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4bedd-5fa4-44d4-89bd-e52f5196d753 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:03.155011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 889/1802] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:02 2022] PUT /identity/v3/projects/4bd6f995e50741fbba1101e6f343effa/users/4b8d9dce157a4f3cbfa1a7295704a4c0/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:03.169210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:03.169715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:03.170172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:03.195092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874619a-c38a-42dc-bbe6-3c2d535ff749 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:03.331180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] MFA Rules not processed for user `4b8d9dce157a4f3cbfa1a7295704a4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:03.333363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:03.467825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:03.511246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:03.574019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:03.574842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:03.575515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:03.576360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:03.603892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 890/1803] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:03.629464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:03.631840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:03.730348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:03.733622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:03.764720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 914/1804] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 885 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:16:03.941104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c9dfc-1fca-4ea8-8ad7-c64495d5d0d4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:03.960554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:03.963828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:03.963828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:03.969735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:04.027604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:04.029128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:04.074232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 891/1805] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:04.346204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:04.378400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d8638-c65a-449d-813a-ef6c6ac06479 service swift] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:04.394649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:04.395568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:04.395914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:04.396199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:04.402746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:04.715403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:04.717115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff31e5-69d9-40d1-b22f-1acd7fc8fd29 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:04.749700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 915/1806] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:05.626215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:05.629202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:05.873913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe774b2-ef65-42bb-95f6-9a59c7db31de service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:05.898173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:05.899120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:05.899431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:05.899781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] PATH_INFO: `/v3/projects/3816c4e9fab2402ab5e19e1c086511fc` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:05.915246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3816c4e9fab2402ab5e19e1c086511fc)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:05.917677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:06.103644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:06.104163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:06.104241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:06.186656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:06.188016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:06.226835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3816c4e9fab2402ab5e19e1c086511fc', 'request_id': 'req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:06.278134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3816c4e9fab2402ab5e19e1c086511fc', 'request_id': 'req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:06.345334 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3816c4e9fab2402ab5e19e1c086511fc', 'request_id': 'req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:06.502528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] The token cache is being invalidate because project 3816c4e9fab2402ab5e19e1c086511fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:06.503035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:06.509477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:06.522769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 892/1807] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:05 2022] DELETE /identity/v3/projects/3816c4e9fab2402ab5e19e1c086511fc => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:06.538502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:06.544708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:06.599405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 916/1808] 10.222.0.26 () {58 vars in 1015 bytes} [Wed Jun 15 22:16:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:06.600423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:06.818471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:06.820145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:06.855941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25999d-608e-4fb9-af6f-db1e4fc584da None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:06.879454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:06.880151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:06.885073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:06.890062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:06.930161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:06.931861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:06.973892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 917/1809] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:07.050721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8469f-b95b-4a59-ab02-962e8b3d9b0d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:07.074068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:07.075016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:07.075309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:07.075589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] PATH_INFO: `/v3/users/98d67b83b49544b789c4b9080dcf0dd9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:07.077096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d67b83b49544b789c4b9080dcf0dd9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:07.079100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:07.251447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d67b83b49544b789c4b9080dcf0dd9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:07.267292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d67b83b49544b789c4b9080dcf0dd9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:07.294375 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d67b83b49544b789c4b9080dcf0dd9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:07.296733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d67b83b49544b789c4b9080dcf0dd9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:07.342554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4e5f050e-a6ff-4620-9a78-25e1d166c27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d67b83b49544b789c4b9080dcf0dd9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:07.383928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 893/1810] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:06 2022] DELETE /identity/v3/users/98d67b83b49544b789c4b9080dcf0dd9 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:09.883296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:09.884805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:09.948847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:10.010229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0e0ec-5087-4096-a090-04e8baad9152 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:10.097963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:10.098716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.099006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.099289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.101387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:10.243178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:10.244847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ea4d3-6ae0-4ca9-9b27-3ea9a6630a16 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:10.261079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 918/1811] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:10.417966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59b6a-e786-46fc-ba64-808cedf0929f None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.418829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59b6a-e786-46fc-ba64-808cedf0929f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.418829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b59b6a-e786-46fc-ba64-808cedf0929f None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.420376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 894/1812] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:16:10.482374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.482471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.482842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.521707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:10.522872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:10.689408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59b6a-e786-46fc-ba64-808cedf0929f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:10.693615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7b59b6a-e786-46fc-ba64-808cedf0929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:10.728312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 919/1813] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:10.758120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:10.764879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:10.796251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b81b7f-21ed-4f1a-aa20-437be18ac915 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:10.807603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb38d5-3967-4135-86f6-0e6cef243e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:10.808886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb38d5-3967-4135-86f6-0e6cef243e6e service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.809182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb38d5-3967-4135-86f6-0e6cef243e6e service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.809507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb38d5-3967-4135-86f6-0e6cef243e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.823010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb38d5-3967-4135-86f6-0e6cef243e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:10.828573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb38d5-3967-4135-86f6-0e6cef243e6e service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:10.844525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b59b6a-e786-46fc-ba64-808cedf0929f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:10.848725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 920/1814] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:10.850437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:10.850589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5d40-eae0-4a51-9cbc-28ccb3479cdf None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.850766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5d40-eae0-4a51-9cbc-28ccb3479cdf None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.851039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5d40-eae0-4a51-9cbc-28ccb3479cdf None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.852056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.852552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.852738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 921/1815] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:16:10.853169 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] PATH_INFO: `/v3/projects/768790c6990f47f49296796eb42bb3b8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.854614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768790c6990f47f49296796eb42bb3b8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:10.856541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:10.858123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.858430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:10.858815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:10.901714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:10.903195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:10.911435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:10.923617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 922/1816] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:10.948275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768790c6990f47f49296796eb42bb3b8', 'request_id': 'req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:10.958441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768790c6990f47f49296796eb42bb3b8', 'request_id': 'req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:10.963111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:10.970370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768790c6990f47f49296796eb42bb3b8', 'request_id': 'req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:10.970751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:10.978460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd5d8f-3013-4764-ae58-056503c3e972 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:10.989089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] The token cache is being invalidate because project 768790c6990f47f49296796eb42bb3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:10.989704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:10.990535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-be01789b-7ab3-4e78-a5d6-8dc0f72fef75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:10.992705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 895/1817] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:10 2022] DELETE /identity/v3/projects/768790c6990f47f49296796eb42bb3b8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:10.999026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492dbcf-1d95-43c4-9256-b904cb775578 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:10.999643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492dbcf-1d95-43c4-9256-b904cb775578 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.000124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492dbcf-1d95-43c4-9256-b904cb775578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.035349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5492dbcf-1d95-43c4-9256-b904cb775578 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:11.036659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5492dbcf-1d95-43c4-9256-b904cb775578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:11.122436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.123146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.125634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.126994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.134613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:11.155861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.158568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.163221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 896/1818] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:11.172400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.172715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.172976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.178248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 923/1819] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:11.212893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:11.214734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:11.228129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 897/1820] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:11.236492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.257497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81937382-4ab0-4a71-9459-4fe645db7fa5 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.265670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.266477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.266860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.267232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.268281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:11.268752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.271161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.287302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 924/1821] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:11.291853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.302191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1b0f5-c6a3-455a-825f-192c98c3f40e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.306884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.307586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.307868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.308146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.308862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.310823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.340803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 898/1822] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:11.345065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.357806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3249c05-1323-4841-a107-00b638822ccd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.423711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.424481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.424765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.425096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.425804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.427760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.449670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 925/1823] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:11 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:11.455151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.467876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf816f-3438-4793-ad65-a4f3d73b9c02 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.473745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.474431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.474717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.474995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.475731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.477389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.489136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 899/1824] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:11.493591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.504493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99cebe-92d3-4b4e-b772-5eab26bf5586 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.511297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f49de-8dec-4e57-abcc-554eec9854ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.511991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f49de-8dec-4e57-abcc-554eec9854ae admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.512299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f49de-8dec-4e57-abcc-554eec9854ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.512597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f49de-8dec-4e57-abcc-554eec9854ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.513353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f49de-8dec-4e57-abcc-554eec9854ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.514991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f49de-8dec-4e57-abcc-554eec9854ae admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.526271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 926/1825] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:11.530608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.542476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c90d33-ce4f-49c5-baab-81f9adf2fea4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.548186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.549114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.550038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.550291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] PATH_INFO: `/v3/projects/b49cdcb5c0be4c1fba0802de8554bc7f/users/88cbfca848bd419fa62c45d60232622e/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.568895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49cdcb5c0be4c1fba0802de8554bc7f, user_id=88cbfca848bd419fa62c45d60232622e, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.571613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.587243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 900/1826] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:11 2022] PUT /identity/v3/projects/b49cdcb5c0be4c1fba0802de8554bc7f/users/88cbfca848bd419fa62c45d60232622e/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:11.597887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.598892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.598892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.629803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] MFA Rules not processed for user `88cbfca848bd419fa62c45d60232622e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:11.631192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:11.697778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:11.733364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 927/1827] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:11.737314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.795949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:11.811027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fed519-25c8-42ee-8254-912dbd0f6d04 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.817036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.817811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.818094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.818370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.819079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.821036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.849621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 901/1828] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:11.853759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.865442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51884852-141a-4daf-9ba3-bf6bb01c8084 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.940172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.940931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.941141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.941446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.942135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:11.944090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:11.970996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 928/1829] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:11 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:11.975411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:11.990959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e210b5-4370-472b-8345-f1d7068f897f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:11.996522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:11.997308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:11.997671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:11.998053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:11.999106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:12.003339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:12.014639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 902/1830] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:12.020254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:12.030799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a34af-1411-466d-8d40-87528c1f797a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:12.036661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:12.037618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:12.037902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:12.038178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] PATH_INFO: `/v3/projects/9f5e937040ff49e2a4188b2c63dd41d3/users/c7da456206ab458bbc4e80b661633e15/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:12.055858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e937040ff49e2a4188b2c63dd41d3, user_id=c7da456206ab458bbc4e80b661633e15, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:12.058709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:12.082477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 929/1831] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:12 2022] PUT /identity/v3/projects/9f5e937040ff49e2a4188b2c63dd41d3/users/c7da456206ab458bbc4e80b661633e15/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:12.088785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:12.115986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db34f1-19f4-42b3-b8cd-c75fd6b5cc2f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:12.208131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a711d-bd18-4a70-ac20-85e4cdcdb572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:12.209564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a711d-bd18-4a70-ac20-85e4cdcdb572 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:12.209854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a711d-bd18-4a70-ac20-85e4cdcdb572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:12.211420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a711d-bd18-4a70-ac20-85e4cdcdb572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:12.212761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a711d-bd18-4a70-ac20-85e4cdcdb572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:12.215820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a711d-bd18-4a70-ac20-85e4cdcdb572 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:12.235195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 903/1832] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:12.247371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:12.268895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfd885-e0b2-467b-9ef9-1f5d247fbaf8 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:12.289462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:12.289817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:12.290509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:12.291415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] PATH_INFO: `/v3/projects/9f5e937040ff49e2a4188b2c63dd41d3/users/c7da456206ab458bbc4e80b661633e15/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:12.295120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e937040ff49e2a4188b2c63dd41d3, user_id=c7da456206ab458bbc4e80b661633e15, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:12.314910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:12.349995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 930/1833] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:12 2022] PUT /identity/v3/projects/9f5e937040ff49e2a4188b2c63dd41d3/users/c7da456206ab458bbc4e80b661633e15/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:12.352063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:12.353231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:12.353862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:12.412055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] MFA Rules not processed for user `c7da456206ab458bbc4e80b661633e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:12.415537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:12.577454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 904/1834] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:12.593025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:12.605264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:12.805596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21abda70-9406-4a4f-ba9a-1b6487977085 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:12.810512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44723-62ca-41a2-bb80-a55d7fe9f1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:12.811508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44723-62ca-41a2-bb80-a55d7fe9f1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:12.811964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44723-62ca-41a2-bb80-a55d7fe9f1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:12.812452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44723-62ca-41a2-bb80-a55d7fe9f1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:12.845465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44723-62ca-41a2-bb80-a55d7fe9f1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:12.848380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44723-62ca-41a2-bb80-a55d7fe9f1b9 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:12.906293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 931/1835] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:13.747367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:13.837932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:13.857804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5114e-cdfb-4fa4-a1a8-b85b764aa73b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:13.864533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:13.866066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:13.867219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:13.867513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] PATH_INFO: `/v3/users/88cbfca848bd419fa62c45d60232622e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:13.869289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cbfca848bd419fa62c45d60232622e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:13.873546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:13.954982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cbfca848bd419fa62c45d60232622e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:13.974048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cbfca848bd419fa62c45d60232622e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:13.997369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cbfca848bd419fa62c45d60232622e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:13.997369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cbfca848bd419fa62c45d60232622e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.021524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cbfca848bd419fa62c45d60232622e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.037139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 905/1836] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:13 2022] DELETE /identity/v3/users/88cbfca848bd419fa62c45d60232622e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:14.039928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:14.040734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:14.040911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:14.068897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:14.070899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:14.178668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:14.230740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 932/1837] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:14.248139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:14.250056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:14.349192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e74470-607c-4efe-8617-9d9fb8104536 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:14.353117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:14.353842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:14.354128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:14.354422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:14.365815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:14.367286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:14.378696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 906/1838] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:14.723046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:14.725403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:14.752952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6067e-52b9-4c0b-b0d8-e6b96230c740 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:14.759671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:14.761496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:14.761854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:14.762208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] PATH_INFO: `/v3/projects/b49cdcb5c0be4c1fba0802de8554bc7f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:14.766315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49cdcb5c0be4c1fba0802de8554bc7f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:14.768607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:14.826664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49cdcb5c0be4c1fba0802de8554bc7f', 'request_id': 'req-a9253fd7-5a49-4690-ae80-6d1d807a1e45'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.846009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49cdcb5c0be4c1fba0802de8554bc7f', 'request_id': 'req-a9253fd7-5a49-4690-ae80-6d1d807a1e45'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.853817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49cdcb5c0be4c1fba0802de8554bc7f', 'request_id': 'req-a9253fd7-5a49-4690-ae80-6d1d807a1e45'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.870595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] The token cache is being invalidate because project b49cdcb5c0be4c1fba0802de8554bc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:14.870900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.871712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:14.876294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 933/1839] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:14 2022] DELETE /identity/v3/projects/b49cdcb5c0be4c1fba0802de8554bc7f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:14.877507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:14.889164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151decbc-cdd4-44e3-89a6-2e2c3eac44d4 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:15.007609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:15.008169 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:15.008262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:15.008610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] PATH_INFO: `/v3/users/c7da456206ab458bbc4e80b661633e15` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:15.010143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7da456206ab458bbc4e80b661633e15)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:15.012127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:15.048803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:15.105532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7da456206ab458bbc4e80b661633e15'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.113843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7da456206ab458bbc4e80b661633e15'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.122279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7da456206ab458bbc4e80b661633e15'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.123313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7da456206ab458bbc4e80b661633e15'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.137251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-44bd9398-3856-4c58-b881-f41bd2a9409b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7da456206ab458bbc4e80b661633e15'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.144486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 907/1840] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:14 2022] DELETE /identity/v3/users/c7da456206ab458bbc4e80b661633e15 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:15.677048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:15.678594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:15.693997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9253fd7-5a49-4690-ae80-6d1d807a1e45 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:15.767307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:15.768317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:15.768613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:15.768898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] PATH_INFO: `/v3/projects/9f5e937040ff49e2a4188b2c63dd41d3` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:15.774041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5e937040ff49e2a4188b2c63dd41d3)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:15.778750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:15.835369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5e937040ff49e2a4188b2c63dd41d3', 'request_id': 'req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.845050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5e937040ff49e2a4188b2c63dd41d3', 'request_id': 'req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.854240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5e937040ff49e2a4188b2c63dd41d3', 'request_id': 'req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.858300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:15.872543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] The token cache is being invalidate because project 9f5e937040ff49e2a4188b2c63dd41d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:15.873177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.879730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4be6ac4e-90f3-49f1-b73e-c507cdc1134d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:15.882129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 934/1841] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:15 2022] DELETE /identity/v3/projects/9f5e937040ff49e2a4188b2c63dd41d3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:15.888936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:15.889573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:15.889573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:15.912150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:15.913628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:15.998317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 908/1842] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:16.011072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.011072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.011072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.062590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:16.065684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:16.084648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 935/1843] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:16.088809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:16.105772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3537-aa69-46d0-9634-d6a14bde9941 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:16.116788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:16.117577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.117882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.118152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.118977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:16.119291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:16.121011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:16.167426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 909/1844] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:16.172092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:16.186592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443a7e-e4a0-4cb1-8bd2-66c36eba6669 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:16.230442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:16.230442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.230442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.234459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.237226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:16.247953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:16.288139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 936/1845] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:16 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:16.292366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:16.325078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facfe88-162f-4bcf-ae5d-c3ea667392e1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:16.487291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:16.502053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.502053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.502436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.504739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:16.508202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:16.545488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 910/1846] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:16 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:16.550139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:16.572742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028d690-bba9-411c-823b-b183f94cc26b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:16.581251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:16.582144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.582613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.584255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.584255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:16.600997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:16.634963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 937/1847] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:16.636780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:16.652482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:16.695628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1681-ed48-4488-8129-fe8d5a117c6e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:16.711712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc21fa-90de-45b2-a263-04921b43ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:16.712532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc21fa-90de-45b2-a263-04921b43ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.713017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc21fa-90de-45b2-a263-04921b43ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.713395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc21fa-90de-45b2-a263-04921b43ed02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.714223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc21fa-90de-45b2-a263-04921b43ed02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:16.720546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc21fa-90de-45b2-a263-04921b43ed02 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:16.769037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 911/1848] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:16.774674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:16.791487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6def34-9e12-40c1-a7c8-7b24a4b256cd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:16.804362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:16.807587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.808221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.808654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] PATH_INFO: `/v3/projects/08e9cd300044456ebd8c92cde72f4601/users/63d698492c134b2892a46bb36b833dbb/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.858278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e9cd300044456ebd8c92cde72f4601, user_id=63d698492c134b2892a46bb36b833dbb, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:16.865929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:16.900439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 938/1849] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:16 2022] PUT /identity/v3/projects/08e9cd300044456ebd8c92cde72f4601/users/63d698492c134b2892a46bb36b833dbb/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:16.914916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:16.915522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:16.915522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:16.971444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] MFA Rules not processed for user `63d698492c134b2892a46bb36b833dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:16.973269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:17.090742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:17.100843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 912/1850] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:17.103928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:17.217539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76028df8-8eb1-4166-b7f1-545367d2e4a3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:17.235769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:17.242205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:17.242507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:17.242802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] PATH_INFO: `/v3/users/f70d7f6f7b074548aebd70f70208da15` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:17.246845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70d7f6f7b074548aebd70f70208da15)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:17.267428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:17.343167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:17.345406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:17.447444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70d7f6f7b074548aebd70f70208da15'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:17.462011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70d7f6f7b074548aebd70f70208da15'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:17.462869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70d7f6f7b074548aebd70f70208da15'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:17.489802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70d7f6f7b074548aebd70f70208da15'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:17.508917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9a43d85-aa47-46c0-8105-e7e8fd82ebd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70d7f6f7b074548aebd70f70208da15'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:17.512119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da268b0e-df76-4fa7-bff4-774d8f609923 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:17.521979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:17.523532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 939/1851] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:17 2022] DELETE /identity/v3/users/f70d7f6f7b074548aebd70f70208da15 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:17.524421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:17.524935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:17.525218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:17.527884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:17.528182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:17.528461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:17.531521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:17.558752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:17.563981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:17.569337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:17.571085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:17.579252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:17.584824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 913/1852] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:17.667523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 940/1853] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:17.721416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:17.723673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:17.897147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3e7eb-b887-40f9-973c-5676fbe0b414 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:17.983512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:17.996686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:17.997771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:17.998394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:17.998777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:18.012983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:18.023877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:18.043642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 914/1854] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:18.710364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:18.712879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:18.727204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d274d1-4652-496a-accb-2b7fe2c75a67 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:18.732595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:18.733880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:18.734290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:18.734660 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] PATH_INFO: `/v3/projects/8079759be7c9436da696d955d0eafaba` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:18.736404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8079759be7c9436da696d955d0eafaba)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:18.739124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:18.812650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8079759be7c9436da696d955d0eafaba', 'request_id': 'req-a0819580-2c40-42e3-8c5b-8d565f5d153f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:18.821188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8079759be7c9436da696d955d0eafaba', 'request_id': 'req-a0819580-2c40-42e3-8c5b-8d565f5d153f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:18.833205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8079759be7c9436da696d955d0eafaba', 'request_id': 'req-a0819580-2c40-42e3-8c5b-8d565f5d153f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:18.879368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] The token cache is being invalidate because project 8079759be7c9436da696d955d0eafaba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:18.880289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:18.880868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:18.886361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 941/1855] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:18 2022] DELETE /identity/v3/projects/8079759be7c9436da696d955d0eafaba => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:18.887701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:18.900032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe8a9a-d0bd-4631-80d3-4cd0882c2bad service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:18.989616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:18.990540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:18.990824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:18.991098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] PATH_INFO: `/v3/users/af78cf8d120b415598f85fded16fc290` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:18.992381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af78cf8d120b415598f85fded16fc290)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:18.995074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:19.077396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af78cf8d120b415598f85fded16fc290'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.093493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af78cf8d120b415598f85fded16fc290'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.125061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af78cf8d120b415598f85fded16fc290'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.125973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af78cf8d120b415598f85fded16fc290'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.152386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af78cf8d120b415598f85fded16fc290'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.165796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 915/1856] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:18 2022] DELETE /identity/v3/users/af78cf8d120b415598f85fded16fc290 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:19.591216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:19.593717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:19.609907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0819580-2c40-42e3-8c5b-8d565f5d153f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:19.678159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:19.679350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:19.679877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:19.680345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] PATH_INFO: `/v3/projects/9c8d90c8c01044cdb5004c1090f21baa` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:19.681853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8d90c8c01044cdb5004c1090f21baa)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:19.684007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:19.733088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:19.748333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8d90c8c01044cdb5004c1090f21baa', 'request_id': 'req-8d188c33-abcb-446a-a8b5-b5b0155ea789'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.753887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8d90c8c01044cdb5004c1090f21baa', 'request_id': 'req-8d188c33-abcb-446a-a8b5-b5b0155ea789'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.760169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8d90c8c01044cdb5004c1090f21baa', 'request_id': 'req-8d188c33-abcb-446a-a8b5-b5b0155ea789'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.775168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] The token cache is being invalidate because project 9c8d90c8c01044cdb5004c1090f21baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:19.775457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.776153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.777775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 942/1857] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:19 2022] DELETE /identity/v3/projects/9c8d90c8c01044cdb5004c1090f21baa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:19.781974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:19.784176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:19.798507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cf9f7-06a6-4fa3-aeed-7ae8b2bbc212 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:19.875794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:19.876595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:19.876867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:19.877138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] PATH_INFO: `/v3/users/a5b5c4c8bdaf46c4b19996d90120aef0` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:19.878431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b5c4c8bdaf46c4b19996d90120aef0)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:19.881020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:19.886164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:19.946774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b5c4c8bdaf46c4b19996d90120aef0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.958349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b5c4c8bdaf46c4b19996d90120aef0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.966281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b5c4c8bdaf46c4b19996d90120aef0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.967107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b5c4c8bdaf46c4b19996d90120aef0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.983764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-28f24ad0-60a5-4a51-bd6c-2137d206e8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b5c4c8bdaf46c4b19996d90120aef0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:19.990252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 916/1858] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:19 2022] DELETE /identity/v3/users/a5b5c4c8bdaf46c4b19996d90120aef0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:20.340925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:20.342717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:20.360270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d188c33-abcb-446a-a8b5-b5b0155ea789 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:20.475405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:20.476884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:20.477134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:20.477605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] PATH_INFO: `/v3/projects/8775e230cefa4b1ebe70605abc34ec86` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:20.478932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8775e230cefa4b1ebe70605abc34ec86)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:20.481117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:20.544576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8775e230cefa4b1ebe70605abc34ec86', 'request_id': 'req-668725a4-e5ca-4d02-b6ee-8b379de1802f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:20.552065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8775e230cefa4b1ebe70605abc34ec86', 'request_id': 'req-668725a4-e5ca-4d02-b6ee-8b379de1802f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:20.560394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8775e230cefa4b1ebe70605abc34ec86', 'request_id': 'req-668725a4-e5ca-4d02-b6ee-8b379de1802f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:20.575252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] The token cache is being invalidate because project 8775e230cefa4b1ebe70605abc34ec86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:20.575550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:20.576370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-668725a4-e5ca-4d02-b6ee-8b379de1802f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:20.578003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 943/1859] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:20 2022] DELETE /identity/v3/projects/8775e230cefa4b1ebe70605abc34ec86 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:20.584172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:20.584460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:20.584736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:20.604550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:20.605843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:20.670812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 917/1860] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:20.679514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:20.679797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:20.680067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:20.702621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:20.703950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:20.713511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 944/1861] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:20.717801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:20.730328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347c1a8-4699-486a-a39c-620c0cf33d3c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:20.736599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:20.736599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:20.737072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:20.737503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:20.738348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:20.738748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:20.740803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:20.773088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 918/1862] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:20.775728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:20.787677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85de4-b26d-49e5-8f1c-32f8c3406244 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:20.794060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:20.794813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:20.795099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:20.795377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:20.796084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:20.798076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:20.840050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 945/1863] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:20 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:20.844115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:20.858039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42418-8d38-48a5-817e-fe8bd6276c93 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:20.936881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:20.937677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:20.938138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:20.938420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:20.939136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:20.942261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:20.964266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:20.977561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 919/1864] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:20 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:20.981483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:20.995512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9135367-9ddd-4ea4-8323-80ade6f33cbd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:21.001836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:21.003217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.004123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.004554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.005633 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:21.009704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:21.024743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 946/1865] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:21.029732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:21.046064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ab1cc-a961-4a6d-9568-5dc865f42efd admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:21.052916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad6ef-b64f-4108-8a51-faaa60e91dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:21.053901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad6ef-b64f-4108-8a51-faaa60e91dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.054357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad6ef-b64f-4108-8a51-faaa60e91dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.054780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad6ef-b64f-4108-8a51-faaa60e91dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.056026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcad6ef-b64f-4108-8a51-faaa60e91dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:21.057764 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcad6ef-b64f-4108-8a51-faaa60e91dd8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:21.076419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 920/1866] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:21.088992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:21.101217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd858f4-e828-4f34-92af-1005b1dfb554 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:21.109628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:21.110780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.111209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.111589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] PATH_INFO: `/v3/projects/cf4329becf0344e196f210cc60b91fba/users/bf7d21fc031c46e6a59c8e5c2ffe2257/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.127554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:21.132715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4329becf0344e196f210cc60b91fba, user_id=bf7d21fc031c46e6a59c8e5c2ffe2257, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:21.135846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:21.161370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 947/1867] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:21 2022] PUT /identity/v3/projects/cf4329becf0344e196f210cc60b91fba/users/bf7d21fc031c46e6a59c8e5c2ffe2257/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:21.174033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.174838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.175341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.212551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] MFA Rules not processed for user `bf7d21fc031c46e6a59c8e5c2ffe2257`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:21.214156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:21.331409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 921/1868] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:21.335657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:21.510192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2709b2-97a0-4a1d-b0df-c429f2b59e09 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:21.517672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:21.518520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.518939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.519285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.520123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:21.523769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:21.579153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 948/1869] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:21 2022] POST /identity/v3/projects => generated 391 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:21.584036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:21.604800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d39f9-3942-41f7-a5f1-602a2a5953a5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:21.819860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:21.822493 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.822787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.823072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.823916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:21.831033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:21.879491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 922/1870] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:21 2022] POST /identity/v3/users => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:21.882760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:21.924330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a55f6-a3f0-4238-a092-da67109ae74d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:21.938903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:21.940010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:21.942256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:21.943276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:21.953636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:21.978425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:22.022215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 949/1871] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:22.026181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:22.052917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06943853-a5b4-4ca4-9afd-0d7bc14d43fc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:22.066498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:22.067845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:22.069084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:22.069468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] PATH_INFO: `/v3/projects/56e9c2482620472c99f167002a9ac1b4/users/09d4467fe4bd422e87ce16fe601ba4d3/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:22.092025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e9c2482620472c99f167002a9ac1b4, user_id=09d4467fe4bd422e87ce16fe601ba4d3, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:22.095087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:22.111059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 923/1872] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:22 2022] PUT /identity/v3/projects/56e9c2482620472c99f167002a9ac1b4/users/09d4467fe4bd422e87ce16fe601ba4d3/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:22.116470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:22.129138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bd61c-23df-4038-8348-98b455546796 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:22.245050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf39d27-7508-4bcd-9115-ff313dc88d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:22.246377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf39d27-7508-4bcd-9115-ff313dc88d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:22.246669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf39d27-7508-4bcd-9115-ff313dc88d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:22.246951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf39d27-7508-4bcd-9115-ff313dc88d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:22.247704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf39d27-7508-4bcd-9115-ff313dc88d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:22.249354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf39d27-7508-4bcd-9115-ff313dc88d2a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:22.264973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 950/1873] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:22.265789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:22.277672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ba660-1362-4a24-b753-74939e8470d4 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:22.283043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:22.284113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:22.284394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:22.284663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] PATH_INFO: `/v3/projects/56e9c2482620472c99f167002a9ac1b4/users/09d4467fe4bd422e87ce16fe601ba4d3/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:22.287622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e9c2482620472c99f167002a9ac1b4, user_id=09d4467fe4bd422e87ce16fe601ba4d3, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:22.290645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:22.308948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 924/1874] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:22 2022] PUT /identity/v3/projects/56e9c2482620472c99f167002a9ac1b4/users/09d4467fe4bd422e87ce16fe601ba4d3/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:22.320440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:22.320440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:22.320440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:22.362248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] MFA Rules not processed for user `09d4467fe4bd422e87ce16fe601ba4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:22.366423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:22.463812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:22.506222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 951/1875] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:22.520116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:22.523111 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:22.581066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:22.627604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefb822-129f-4593-93c8-0926bd7ac41a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:22.635452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:22.636884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:22.637424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:22.637882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:22.652997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:22.654722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:22.676476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 925/1876] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:22.760847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:22.762431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:22.776246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c43f6-96ef-4897-8461-5f4aa94a5508 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:22.782459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3da3c5-cd24-4dfc-9a17-44f8c3cb5be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:22.783333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da3c5-cd24-4dfc-9a17-44f8c3cb5be8 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:22.783691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da3c5-cd24-4dfc-9a17-44f8c3cb5be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:22.784219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3da3c5-cd24-4dfc-9a17-44f8c3cb5be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:22.860576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da3c5-cd24-4dfc-9a17-44f8c3cb5be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:22.862018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3da3c5-cd24-4dfc-9a17-44f8c3cb5be8 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:22.872389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 952/1877] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:27.828285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:27.921987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c8ac-40ec-466c-9c53-5976cb04ac61 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:27.928419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:27.929365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:27.929673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:27.929926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] PATH_INFO: `/v3/users/bf7d21fc031c46e6a59c8e5c2ffe2257` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:27.932397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7d21fc031c46e6a59c8e5c2ffe2257)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:27.934893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:28.009548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7d21fc031c46e6a59c8e5c2ffe2257'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:28.022668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7d21fc031c46e6a59c8e5c2ffe2257'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:28.031441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7d21fc031c46e6a59c8e5c2ffe2257'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:28.032535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7d21fc031c46e6a59c8e5c2ffe2257'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:28.047288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7d21fc031c46e6a59c8e5c2ffe2257'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:28.056092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 926/1878] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:27 2022] DELETE /identity/v3/users/bf7d21fc031c46e6a59c8e5c2ffe2257 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:28.062995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:28.063572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:28.063770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:28.089418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:28.091107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:28.170026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 953/1879] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:28.182506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:28.184966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:28.279322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42f7f4-5f8c-43f0-b22e-98c41cb35162 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:28.284436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:28.285151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:28.285466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:28.285735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:28.295960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:28.298578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:28.300458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:28.316458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 927/1880] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:28.797263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:28.799175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:28.823484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3938-8440-41af-8589-a17fa9b20535 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:28.831380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:28.833044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:28.833805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:28.835207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] PATH_INFO: `/v3/projects/cf4329becf0344e196f210cc60b91fba` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:28.837761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4329becf0344e196f210cc60b91fba)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:28.841718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:28.959282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4329becf0344e196f210cc60b91fba', 'request_id': 'req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:28.973450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4329becf0344e196f210cc60b91fba', 'request_id': 'req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.019210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4329becf0344e196f210cc60b91fba', 'request_id': 'req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.052828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] The token cache is being invalidate because project cf4329becf0344e196f210cc60b91fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:29.053312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.055841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.064457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 954/1881] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:28 2022] DELETE /identity/v3/projects/cf4329becf0344e196f210cc60b91fba => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:29.066078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:29.082098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65ecb1-e8ff-4e40-abb8-eff8ef58e792 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:29.186650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:29.187606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:29.187896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:29.188181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] PATH_INFO: `/v3/users/09d4467fe4bd422e87ce16fe601ba4d3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:29.190170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d4467fe4bd422e87ce16fe601ba4d3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:29.192151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:29.305547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d4467fe4bd422e87ce16fe601ba4d3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.319965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d4467fe4bd422e87ce16fe601ba4d3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.332543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d4467fe4bd422e87ce16fe601ba4d3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.333440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d4467fe4bd422e87ce16fe601ba4d3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.361669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d4467fe4bd422e87ce16fe601ba4d3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.377724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 928/1882] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:29 2022] DELETE /identity/v3/users/09d4467fe4bd422e87ce16fe601ba4d3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:29.649769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:29.665425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:29.683463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313740fa-fb6d-4d30-8e35-a5d04d1d36eb admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:29.689134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:29.705632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:29.707584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:29.768237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:29.769837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:29.770400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:29.771190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] PATH_INFO: `/v3/users/b58d0a1729e54afd94225e1b0d00433c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:29.772942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58d0a1729e54afd94225e1b0d00433c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:29.775760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:29.787486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36b8ce-4863-4d21-9464-9f523dc5b929 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:29.793779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:29.794821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:29.795132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:29.795389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] PATH_INFO: `/v3/users/63d698492c134b2892a46bb36b833dbb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:29.798115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d698492c134b2892a46bb36b833dbb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:29.801142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:29.820636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:29.840591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58d0a1729e54afd94225e1b0d00433c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.850484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58d0a1729e54afd94225e1b0d00433c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.851323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58d0a1729e54afd94225e1b0d00433c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.861946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d698492c134b2892a46bb36b833dbb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.867867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58d0a1729e54afd94225e1b0d00433c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.871082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d698492c134b2892a46bb36b833dbb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.875862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58d0a1729e54afd94225e1b0d00433c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.879160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d698492c134b2892a46bb36b833dbb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.880914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d698492c134b2892a46bb36b833dbb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.885091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 955/1883] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:29 2022] DELETE /identity/v3/users/b58d0a1729e54afd94225e1b0d00433c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:29.885091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:29.885091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:29.896459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c31de4a5-891b-4543-9f31-3aa32db4e861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d698492c134b2892a46bb36b833dbb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:29.904147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 929/1884] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:29 2022] DELETE /identity/v3/users/63d698492c134b2892a46bb36b833dbb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:29.907609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c667db3-3d3a-40e5-87c5-fe82766a2010 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:29.907609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c667db3-3d3a-40e5-87c5-fe82766a2010 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:29.907609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c667db3-3d3a-40e5-87c5-fe82766a2010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:29.926680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9c667db3-3d3a-40e5-87c5-fe82766a2010 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:29.928124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9c667db3-3d3a-40e5-87c5-fe82766a2010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:29.961753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe0231-1b79-4391-b9e2-a5b0a294bc78 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:29.996191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:29.997688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 930/1885] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:29.999317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:29.999604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:29.999919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.026445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:30.027676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.041709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 931/1886] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:30.042570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:30.045695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.051485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:30.053234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.053552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.059601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] PATH_INFO: `/v3/projects/56e9c2482620472c99f167002a9ac1b4` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.061417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e9c2482620472c99f167002a9ac1b4)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:30.064207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:30.126670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e9c2482620472c99f167002a9ac1b4', 'request_id': 'req-63596e31-1ed3-487c-8e07-6cd09183cd79'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:30.127315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf9a0-e76f-40a0-a000-4caf37ba9018 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:30.133695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e9c2482620472c99f167002a9ac1b4', 'request_id': 'req-63596e31-1ed3-487c-8e07-6cd09183cd79'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:30.141561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e9c2482620472c99f167002a9ac1b4', 'request_id': 'req-63596e31-1ed3-487c-8e07-6cd09183cd79'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:30.170227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] The token cache is being invalidate because project 56e9c2482620472c99f167002a9ac1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:30.170733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:30.174019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:30.181626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 956/1887] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:29 2022] DELETE /identity/v3/projects/56e9c2482620472c99f167002a9ac1b4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:30.183154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:30.185687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.188928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:30.198919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:30.200019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.201265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.234986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63596e31-1ed3-487c-8e07-6cd09183cd79 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:30.241092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.245951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:30.247130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.248469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.248759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.249648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.254352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.394843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:30.406170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d02e3-a954-4748-9278-7be9949e3a4f service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:30.431306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:30.433068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ded3d3-ff5b-402d-be5f-a56d17189e01 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:30.440093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 932/1888] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:30.441583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.443677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.444028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.459099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 957/1889] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:30.480815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:30.481886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.509686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 933/1890] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:30.515004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.515342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.515768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.558692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:30.561194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:30.577901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:30.579146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 958/1891] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:30.599947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7ed0-b9da-406f-b1b9-440bdb3f7fff None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:30.609506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:30.610225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.610499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.610774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.611645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:30.611970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:30.613687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:30.644861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 934/1892] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:30.646661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:30.683551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19061b1-8558-4f8c-9f3d-b4b7d8a2db4e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:30.701249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:30.703046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.703176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.703682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.708410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:30.717661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:30.808977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 959/1893] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:30 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:30.809157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:30.824597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc746dd-bdaf-4986-a7ac-8f07e8b5b3b5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:30.918207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:30.921165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:30.921497 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:30.921784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:30.925929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:30.929505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:30.986182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 935/1894] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:30 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:30.991103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.005050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca143-3fe8-4b5f-9dd0-33732bc53279 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.021764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.022506 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.022862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.023051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.023908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.030712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.046156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 960/1895] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:31.050282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.066990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d379eb8-3760-422c-8a36-e2077632b537 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.085231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.086095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.086344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.086688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.087489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.089206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.108972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 936/1896] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:31.113536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.119036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.120950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.130715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207faac4-ced5-47ef-9608-242b9cbfa1bc admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.135793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f6a62-69d6-489a-80e3-35719d7c423e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.138493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca259da-80d1-4551-ac77-df8d47083ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.139716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca259da-80d1-4551-ac77-df8d47083ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.140768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca259da-80d1-4551-ac77-df8d47083ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.141168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca259da-80d1-4551-ac77-df8d47083ed9 admin admin] PATH_INFO: `/v3/projects/0fe061a4efdc4a99b0f273cacca243eb/users/7f7bc77419b84a86a24f533a32c2d69b/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.142662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.143861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.144290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.144703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] PATH_INFO: `/v3/projects/737ba7372c324dfbaac1f9f889a371a8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.146434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737ba7372c324dfbaac1f9f889a371a8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.148666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.163345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca259da-80d1-4551-ac77-df8d47083ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe061a4efdc4a99b0f273cacca243eb, user_id=7f7bc77419b84a86a24f533a32c2d69b, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.167459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca259da-80d1-4551-ac77-df8d47083ed9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.171672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:31.209653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 961/1897] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:31 2022] PUT /identity/v3/projects/0fe061a4efdc4a99b0f273cacca243eb/users/7f7bc77419b84a86a24f533a32c2d69b/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:31.220702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868830e4-4385-44f9-90d7-019869057cbd None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.221220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868830e4-4385-44f9-90d7-019869057cbd None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.221942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868830e4-4385-44f9-90d7-019869057cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.248161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:31.251770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737ba7372c324dfbaac1f9f889a371a8', 'request_id': 'req-b1da3c2e-091b-45de-8db6-b6bca7b909c6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.267569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737ba7372c324dfbaac1f9f889a371a8', 'request_id': 'req-b1da3c2e-091b-45de-8db6-b6bca7b909c6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.280096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-868830e4-4385-44f9-90d7-019869057cbd None None] MFA Rules not processed for user `7f7bc77419b84a86a24f533a32c2d69b`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:31.281644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-868830e4-4385-44f9-90d7-019869057cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.284182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737ba7372c324dfbaac1f9f889a371a8', 'request_id': 'req-b1da3c2e-091b-45de-8db6-b6bca7b909c6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.301728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] The token cache is being invalidate because project 737ba7372c324dfbaac1f9f889a371a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:31.302518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.303689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.306641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 937/1898] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:31 2022] DELETE /identity/v3/projects/737ba7372c324dfbaac1f9f889a371a8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:31.313800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.315844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.399896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 962/1899] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:31.413063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868830e4-4385-44f9-90d7-019869057cbd None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.415605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da3c2e-091b-45de-8db6-b6bca7b909c6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.416789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-868830e4-4385-44f9-90d7-019869057cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.428265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.429381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.429667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.429945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] PATH_INFO: `/v3/users/f2ebbdd45573442aa7909abee051185b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.433732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ebbdd45573442aa7909abee051185b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.436008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.508610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ebbdd45573442aa7909abee051185b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.514079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868830e4-4385-44f9-90d7-019869057cbd None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.519271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.520187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.520602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.521163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.522892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ebbdd45573442aa7909abee051185b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.533341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.534856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.535868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ebbdd45573442aa7909abee051185b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.537368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ebbdd45573442aa7909abee051185b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.545448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 963/1900] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:31.546347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.547708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.556610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ebbdd45573442aa7909abee051185b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.562644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab87ea-3270-4f3a-b044-5cc217ddafc6 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.569748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 938/1901] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:31 2022] DELETE /identity/v3/users/f2ebbdd45573442aa7909abee051185b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:31.569965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.569965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.569965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.570228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] PATH_INFO: `/v3/projects/08e9cd300044456ebd8c92cde72f4601` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.571391 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e9cd300044456ebd8c92cde72f4601)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.573529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:31.584765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:31.594339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.662999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e9cd300044456ebd8c92cde72f4601', 'request_id': 'req-d87ff685-56e5-4760-97e8-60a9c09f55e0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.682556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e9cd300044456ebd8c92cde72f4601', 'request_id': 'req-d87ff685-56e5-4760-97e8-60a9c09f55e0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.694898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e9cd300044456ebd8c92cde72f4601', 'request_id': 'req-d87ff685-56e5-4760-97e8-60a9c09f55e0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.719854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] The token cache is being invalidate because project 08e9cd300044456ebd8c92cde72f4601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:31.720154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.721300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d87ff685-56e5-4760-97e8-60a9c09f55e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:31.729716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 964/1902] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:31 2022] DELETE /identity/v3/projects/08e9cd300044456ebd8c92cde72f4601 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:31.745200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ec9ce-eda5-4ffd-8313-78a36d264955 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.749314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ec9ce-eda5-4ffd-8313-78a36d264955 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.749794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ec9ce-eda5-4ffd-8313-78a36d264955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.764794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:31.776243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478713-c366-4923-939c-734785c05d7c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:31.801131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-072ec9ce-eda5-4ffd-8313-78a36d264955 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:31.808062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-072ec9ce-eda5-4ffd-8313-78a36d264955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:31.825261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:31.961484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:31.963586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:31.964491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:31.964947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] PATH_INFO: `/v3/users/7f7bc77419b84a86a24f533a32c2d69b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:31.968022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7bc77419b84a86a24f533a32c2d69b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:31.973406 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.012381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 965/1903] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:32.023449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.023775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.024009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.046768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:32.048009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.067671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 966/1904] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:32.068583 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.086046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6966c-f595-4347-a07b-09c9578dba98 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.092815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7bc77419b84a86a24f533a32c2d69b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.093807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.094620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.095592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.095857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.097782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:32.098470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.102665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.119817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7bc77419b84a86a24f533a32c2d69b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.134758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 967/1905] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:32.137428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.145439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7bc77419b84a86a24f533a32c2d69b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.147215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7bc77419b84a86a24f533a32c2d69b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.159544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db01a42-090c-4c6e-9915-3734def5757a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.170766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7bc77419b84a86a24f533a32c2d69b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.175681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e54db-b936-4ea5-b9b1-0d838f45cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.180817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e54db-b936-4ea5-b9b1-0d838f45cb33 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.181307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e54db-b936-4ea5-b9b1-0d838f45cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.181634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e54db-b936-4ea5-b9b1-0d838f45cb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.182759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e54db-b936-4ea5-b9b1-0d838f45cb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.185479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 939/1906] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:31 2022] DELETE /identity/v3/users/7f7bc77419b84a86a24f533a32c2d69b => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:32.186511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.187305 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e54db-b936-4ea5-b9b1-0d838f45cb33 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.189697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.256649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 968/1907] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:32.261865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.262159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.262477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.302999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:32.304236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.423102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 969/1908] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:32.423102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.424878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.426978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2260dc-1dbf-4c07-9af1-97623549f581 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.436232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.439326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.439615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.439889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] PATH_INFO: `/v3/projects/fdc522d7295147f3b8f374349a1a7e95` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.442319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc522d7295147f3b8f374349a1a7e95)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.447103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.450455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ceed01-1674-4971-884a-77d358d4be3f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.455828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b2bdc-c923-446d-9a1b-5612b4b18885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.456713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b2bdc-c923-446d-9a1b-5612b4b18885 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.456995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b2bdc-c923-446d-9a1b-5612b4b18885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.457290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b2bdc-c923-446d-9a1b-5612b4b18885 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.458347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b2bdc-c923-446d-9a1b-5612b4b18885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.460711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b2bdc-c923-446d-9a1b-5612b4b18885 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.485816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 970/1909] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/users => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:32.487458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a045a-f32f-4118-9e93-24debc94efbf None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.487762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a045a-f32f-4118-9e93-24debc94efbf None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.488045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a045a-f32f-4118-9e93-24debc94efbf None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.490961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 971/1910] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:16:32.491795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a045a-f32f-4118-9e93-24debc94efbf None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.494299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9e0a045a-f32f-4118-9e93-24debc94efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.568468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:32.585316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a045a-f32f-4118-9e93-24debc94efbf None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.590324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.591890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.592239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.592626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.601307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:32.604036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc522d7295147f3b8f374349a1a7e95', 'request_id': 'req-8b8e7bc4-682d-4117-8aa4-55249cab19b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.607048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.609499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.627509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc522d7295147f3b8f374349a1a7e95', 'request_id': 'req-8b8e7bc4-682d-4117-8aa4-55249cab19b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.629221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc522d7295147f3b8f374349a1a7e95', 'request_id': 'req-8b8e7bc4-682d-4117-8aa4-55249cab19b3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.633234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 972/1911] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:32.634444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.644017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] The token cache is being invalidate because project fdc522d7295147f3b8f374349a1a7e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:32.644383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.645000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8b8e7bc4-682d-4117-8aa4-55249cab19b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:32.651478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 940/1912] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:32 2022] DELETE /identity/v3/projects/fdc522d7295147f3b8f374349a1a7e95 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:32.653730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c6d4a-9799-4011-bc17-422fde584388 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.654014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c6d4a-9799-4011-bc17-422fde584388 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.654288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c6d4a-9799-4011-bc17-422fde584388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.655146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3891d9-8ba8-4318-8869-f386c7dba8dc service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.680862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8a3c6d4a-9799-4011-bc17-422fde584388 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:32.681908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8a3c6d4a-9799-4011-bc17-422fde584388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.772873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922312a-c352-4e35-8be2-834b1500ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.773802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922312a-c352-4e35-8be2-834b1500ac0d admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.773985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922312a-c352-4e35-8be2-834b1500ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.774264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922312a-c352-4e35-8be2-834b1500ac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.775177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922312a-c352-4e35-8be2-834b1500ac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.777258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922312a-c352-4e35-8be2-834b1500ac0d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.791609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 973/1913] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:32.793035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.793359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.793623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.815913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:32.817457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.836353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 974/1914] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:32.836353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.836353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.845548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3e9ad-2bcf-4e0f-9ddb-53a673b3519e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.847613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 941/1915] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:32.849752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.850276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.850804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.851462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.852161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.852599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.853010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.853800 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.855502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.873555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 975/1916] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:32.877140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.896871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:32.897937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1fd08-4e43-4538-ba65-d315dd784513 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.898165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.904016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.904999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.905280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.905618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] PATH_INFO: `/v3/projects/f6a1009f50914a0f9061fc1721ba0b0d/users/8b8d5037d7b84569ae9eff93c510e0dd/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.911528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 942/1917] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:32.914659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.929699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a1009f50914a0f9061fc1721ba0b0d, user_id=8b8d5037d7b84569ae9eff93c510e0dd, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.931720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e1223-3cdd-47cd-8b1b-857c99b9ce7e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:32.933088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.937917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:32.938704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.939183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.939670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:32.940661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:32.940966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:32.943459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3d5af-70e3-4e4f-961f-553100943d5b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:32.952471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 976/1918] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:32 2022] PUT /identity/v3/projects/f6a1009f50914a0f9061fc1721ba0b0d/users/8b8d5037d7b84569ae9eff93c510e0dd/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:32.960259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:32.963533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:32.969598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 943/1919] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:32.969598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:32.969598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:32.969598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.015780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] MFA Rules not processed for user `8b8d5037d7b84569ae9eff93c510e0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:33.017769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:33.099130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2f10d-1bd7-48e1-870e-c2d42835b863 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.105617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.106441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.106721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.107007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.118447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.120128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.133981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 977/1920] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:33.134988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.177654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 944/1921] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:33.178761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.180568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:33.182870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:33.208850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:33.250206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ded4e-a2bb-4f45-b1bf-8303a650da92 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.262621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.264372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.264889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.265450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.267055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.271599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.311806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1254b8-70dd-4c50-9e25-74b22e48a3fe None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.319996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 978/1922] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:33 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:33.319996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.394003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.395198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.395569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.395957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] PATH_INFO: `/v3/projects/0fe061a4efdc4a99b0f273cacca243eb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.397883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe061a4efdc4a99b0f273cacca243eb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.402522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.467309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541a57f-a1cb-4ab7-9bea-e9670b9cbfc4 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.495616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe061a4efdc4a99b0f273cacca243eb', 'request_id': 'req-9de3f989-e8e2-403b-84bd-7c484f26e2f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:33.528930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe061a4efdc4a99b0f273cacca243eb', 'request_id': 'req-9de3f989-e8e2-403b-84bd-7c484f26e2f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:33.547920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe061a4efdc4a99b0f273cacca243eb', 'request_id': 'req-9de3f989-e8e2-403b-84bd-7c484f26e2f1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:33.571059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] The token cache is being invalidate because project 0fe061a4efdc4a99b0f273cacca243eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:33.571363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:33.572679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:33.581439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 945/1923] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:33 2022] DELETE /identity/v3/projects/0fe061a4efdc4a99b0f273cacca243eb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:33.581876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.583885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:33.659500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:33.664850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.674119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.678986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.679446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.680245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.683091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.688357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f989-e8e2-403b-84bd-7c484f26e2f1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.699883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa342c-3889-4b84-80d4-0e42d148fda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.700604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa342c-3889-4b84-80d4-0e42d148fda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.700890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa342c-3889-4b84-80d4-0e42d148fda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.701169 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa342c-3889-4b84-80d4-0e42d148fda0 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.701935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa342c-3889-4b84-80d4-0e42d148fda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.703939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa342c-3889-4b84-80d4-0e42d148fda0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.746655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 946/1924] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:33 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:33.748368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.748658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.748938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.776894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 979/1925] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:33 2022] POST /identity/v3/projects => generated 375 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:33.778493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.795853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:33.799900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:33.891924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:33.912574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6bd824-7851-49eb-bf01-a2e172adf55a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.919298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45b045-b8f0-43ef-a018-e0dd92ebfbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.919797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 947/1926] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:33.920775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.922047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b045-b8f0-43ef-a018-e0dd92ebfbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.922333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b045-b8f0-43ef-a018-e0dd92ebfbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.922616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45b045-b8f0-43ef-a018-e0dd92ebfbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.923372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b045-b8f0-43ef-a018-e0dd92ebfbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.925021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45b045-b8f0-43ef-a018-e0dd92ebfbe2 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.926461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:33.939286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 980/1927] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:33.943178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b2840-5280-41c2-a0b7-903ada63455c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:33.944826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.945457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.946049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.948655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:33.949671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:33.950681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:33.950942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:33.951671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:33.953997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:33.969474 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:33.971380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:33.982634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 948/1928] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:33 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:33.983351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:33.994407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ded26-a96d-4315-b686-1a615278864f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.002894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 981/1929] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:34.003106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.003832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.004186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.004475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.005562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.006199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.007741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.019600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3768b7a-d56c-425c-a690-0da49bc77d2b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.020459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 949/1930] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:34.025103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.026144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.026942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.027284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.027623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.028464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.030423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.038672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4d253-0930-441e-b5b8-63b8652c3370 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.044739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 982/1931] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:34.046078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.049418 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.050383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.050662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.050936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.052347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:34.052675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.054377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.067508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572715-5e2a-4127-bd6d-a2d5b0bc62fe admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.072045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 950/1932] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:34.073164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.077652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.078686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.078965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.079352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] PATH_INFO: `/v3/projects/06025f6a2d4543f79273f9fdbe27b446/users/3c04ccc4c4994d81a5ee58f9291cb1e1/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.092712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b3f59-b4af-46e1-b18a-dd422688c782 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.098300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.099615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.099944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.100172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] PATH_INFO: `/v3/projects/40d4adc4c87640fa8cafbfe0bb96c479/users/ab7ee0dd49e64323b8bebd9adfca9ca1/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.106912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06025f6a2d4543f79273f9fdbe27b446, user_id=3c04ccc4c4994d81a5ee58f9291cb1e1, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.111127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.120357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d4adc4c87640fa8cafbfe0bb96c479, user_id=ab7ee0dd49e64323b8bebd9adfca9ca1, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.123515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.149404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 983/1933] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:34 2022] PUT /identity/v3/projects/06025f6a2d4543f79273f9fdbe27b446/users/3c04ccc4c4994d81a5ee58f9291cb1e1/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:34.149404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.150359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 951/1934] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:34 2022] PUT /identity/v3/projects/40d4adc4c87640fa8cafbfe0bb96c479/users/ab7ee0dd49e64323b8bebd9adfca9ca1/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:34.150359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.256027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020baa8f-9c77-4a38-b14a-8606ac7aa309 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.261777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4bbb7-38de-4823-9427-1906a26878d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.262488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4bbb7-38de-4823-9427-1906a26878d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.262837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4bbb7-38de-4823-9427-1906a26878d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.263119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4bbb7-38de-4823-9427-1906a26878d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.263279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d3915-ab91-4a83-ae33-d416fda09c3b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.263879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4bbb7-38de-4823-9427-1906a26878d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.265566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4bbb7-38de-4823-9427-1906a26878d9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.269989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.271029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.271277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.271674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.272448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.274736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.279116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 952/1935] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:34.280820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.281275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.281855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.303326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:34.312610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 984/1936] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:34.313490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.319663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] MFA Rules not processed for user `3c04ccc4c4994d81a5ee58f9291cb1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:34.323629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:34.421517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecc1a8-9e10-4f2a-98ac-8adf5675fe37 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.428205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.428757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.429045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.429351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] PATH_INFO: `/v3/projects/40d4adc4c87640fa8cafbfe0bb96c479/users/ab7ee0dd49e64323b8bebd9adfca9ca1/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.431558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d4adc4c87640fa8cafbfe0bb96c479, user_id=ab7ee0dd49e64323b8bebd9adfca9ca1, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.434363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.446886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 953/1937] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:34.447861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.449760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 985/1938] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:34 2022] PUT /identity/v3/projects/40d4adc4c87640fa8cafbfe0bb96c479/users/ab7ee0dd49e64323b8bebd9adfca9ca1/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:34.456358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.466957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc44e-b837-47a0-b4a6-2418912a42cd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.504298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:34.539707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26974407-49d2-4800-b8b3-6f5a03e34db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.543135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974407-49d2-4800-b8b3-6f5a03e34db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.543135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974407-49d2-4800-b8b3-6f5a03e34db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.543135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26974407-49d2-4800-b8b3-6f5a03e34db9 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.543135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974407-49d2-4800-b8b3-6f5a03e34db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.544459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26974407-49d2-4800-b8b3-6f5a03e34db9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.560351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289fac8-f1df-47a3-8722-4e6e90be45cc admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.566977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.567824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.568180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.568387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.569189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.571909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.577778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 954/1939] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:34.580352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.580919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.582260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.604502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 986/1940] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:34.604502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.624896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] MFA Rules not processed for user `ab7ee0dd49e64323b8bebd9adfca9ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:34.626374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:34.700537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853b13-6755-48c3-9a0c-3fba173c1083 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.706091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.706761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.707093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.707458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.708282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.710959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.719524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 955/1941] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:34.720434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.725926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 987/1942] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:34.727617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.733216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9be0c-74fa-4e04-aa3d-273f395cc7bb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.737680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd1ae2-1b49-40ee-8049-f5aab88f7f48 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.738051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.738717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.739001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.739355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.740020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.742043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.743242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.743843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.744132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.744440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.745185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.746848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.758264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:34.759679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 988/1943] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:34.760722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.762945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:34.765469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 956/1944] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:34.767353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.779200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301cd7b-d73f-4bb0-900c-7c2208f3c143 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.785562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.786992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.787277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.787556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] PATH_INFO: `/v3/projects/29e579caa3004d389a6dc075dabdc05a/users/dc90fa5675084e6f899834aba28e488c/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.805596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e579caa3004d389a6dc075dabdc05a, user_id=dc90fa5675084e6f899834aba28e488c, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.808121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.825635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 957/1945] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:34 2022] PUT /identity/v3/projects/29e579caa3004d389a6dc075dabdc05a/users/dc90fa5675084e6f899834aba28e488c/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:34.826545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:34.849883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615ac5e-fe33-432d-b8de-371e0b451a12 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.914476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7cbbe-75af-4643-8a89-0b51bd2aa6c9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:34.919282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.920205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4ca2-bb51-45a8-8fe7-32620c7c8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:34.920782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.920890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4ca2-bb51-45a8-8fe7-32620c7c8abe admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.921881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4ca2-bb51-45a8-8fe7-32620c7c8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.921881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4ca2-bb51-45a8-8fe7-32620c7c8abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.922171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4ca2-bb51-45a8-8fe7-32620c7c8abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:34.922805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.923325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.923774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4ca2-bb51-45a8-8fe7-32620c7c8abe admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:34.927643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:34.936429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:34.936769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 958/1946] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:34.938691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:34.938991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:34.939336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:34.995738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] MFA Rules not processed for user `dc90fa5675084e6f899834aba28e488c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:34.998008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:35.064517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:35.068974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:35.081446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 989/1947] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:35.082741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:35.096348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 959/1948] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:35.101680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aca0e5-ac62-4662-9b90-18579d550922 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:35.108287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:35.109223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:35.109545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:35.109823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] PATH_INFO: `/v3/projects/d26faf95d0f240f9aa9f4ee45715b5fe/users/f957f0fd02f641aabfea7e28e44770b9/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:35.112765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:35.117447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:35.158344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26faf95d0f240f9aa9f4ee45715b5fe, user_id=f957f0fd02f641aabfea7e28e44770b9, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:35.161117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:35.193399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 990/1949] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:35 2022] PUT /identity/v3/projects/d26faf95d0f240f9aa9f4ee45715b5fe/users/f957f0fd02f641aabfea7e28e44770b9/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:35.198893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:35.202873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829c893-4ad4-43f1-8349-c1f169df5ea2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:35.241587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:35.299556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d239c1-a8c4-45ce-b095-3469103de209 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:35.301038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d239c1-a8c4-45ce-b095-3469103de209 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:35.301356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d239c1-a8c4-45ce-b095-3469103de209 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:35.301607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d239c1-a8c4-45ce-b095-3469103de209 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:35.357602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8c0e4-d0d4-4f53-801d-fc5fc02c0107 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:35.366503 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:35.367038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:35.367414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:35.367621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:35.368399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:35.370098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:35.384941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 991/1950] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:35.403787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:35.406380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d239c1-a8c4-45ce-b095-3469103de209 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:35.409071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d239c1-a8c4-45ce-b095-3469103de209 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:35.427495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dc4dd-aee2-4a25-94e7-e366889d8d27 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:35.434831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:35.435874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:35.436198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:35.436545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] PATH_INFO: `/v3/projects/d26faf95d0f240f9aa9f4ee45715b5fe/users/f957f0fd02f641aabfea7e28e44770b9/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:35.439397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26faf95d0f240f9aa9f4ee45715b5fe, user_id=f957f0fd02f641aabfea7e28e44770b9, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:35.439779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 960/1951] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:35.445003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:35.460221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 992/1952] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:35 2022] PUT /identity/v3/projects/d26faf95d0f240f9aa9f4ee45715b5fe/users/f957f0fd02f641aabfea7e28e44770b9/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:35.470970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:35.471245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:35.471528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:35.579227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] MFA Rules not processed for user `f957f0fd02f641aabfea7e28e44770b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:35.580502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:35.783073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 961/1953] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:35.801299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:35.914312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea113c-4b3c-46ce-99d3-edc28734a28f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:35.919417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:35.920801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:35.921466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:35.922290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:35.938133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:35.939703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:35.951030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 993/1954] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:36.027542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:36.039134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef2a9d-64ee-44c3-8864-a133cc79c997 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:36.043778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac78b9-6dc9-4ba2-846f-45665cf273fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:36.044785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac78b9-6dc9-4ba2-846f-45665cf273fe service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:36.045101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac78b9-6dc9-4ba2-846f-45665cf273fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:36.045433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac78b9-6dc9-4ba2-846f-45665cf273fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:36.109460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:36.125294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac78b9-6dc9-4ba2-846f-45665cf273fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:36.127306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac78b9-6dc9-4ba2-846f-45665cf273fe service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:36.150459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 962/1955] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:37.904582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:37.915995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:38.031200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099d2e-2f9a-4597-8bdc-eb4952bc7f4a service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:38.037257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:38.039264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:38.039586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:38.039901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] PATH_INFO: `/v3/users/8b8d5037d7b84569ae9eff93c510e0dd` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:38.041549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8d5037d7b84569ae9eff93c510e0dd)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:38.043605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:38.117781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8d5037d7b84569ae9eff93c510e0dd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.126876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8d5037d7b84569ae9eff93c510e0dd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.127679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8d5037d7b84569ae9eff93c510e0dd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.144584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8d5037d7b84569ae9eff93c510e0dd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.152372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8d5037d7b84569ae9eff93c510e0dd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.160637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 994/1956] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:37 2022] DELETE /identity/v3/users/8b8d5037d7b84569ae9eff93c510e0dd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:38.164985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12901286-ede3-4514-9bda-19140e155ace None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:38.165494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12901286-ede3-4514-9bda-19140e155ace None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:38.165635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12901286-ede3-4514-9bda-19140e155ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:38.186151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-12901286-ede3-4514-9bda-19140e155ace None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:38.187913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-12901286-ede3-4514-9bda-19140e155ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:38.267726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 963/1957] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:38.279081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:38.280811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:38.361698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85eabef-225d-4ad2-8ebd-df90c66891d0 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:38.366221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:38.366890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:38.367174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:38.367449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:38.377526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:38.378974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:38.389010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 995/1958] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:38.671651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12901286-ede3-4514-9bda-19140e155ace None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:38.673161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-12901286-ede3-4514-9bda-19140e155ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:38.688413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12901286-ede3-4514-9bda-19140e155ace None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:38.696903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:38.697866 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:38.698156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:38.698438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] PATH_INFO: `/v3/projects/f6a1009f50914a0f9061fc1721ba0b0d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:38.699977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a1009f50914a0f9061fc1721ba0b0d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:38.702031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:38.750713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a1009f50914a0f9061fc1721ba0b0d', 'request_id': 'req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.758581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a1009f50914a0f9061fc1721ba0b0d', 'request_id': 'req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.765160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a1009f50914a0f9061fc1721ba0b0d', 'request_id': 'req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.776403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] The token cache is being invalidate because project f6a1009f50914a0f9061fc1721ba0b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:38.776690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.777315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.778890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 964/1959] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:38 2022] DELETE /identity/v3/projects/f6a1009f50914a0f9061fc1721ba0b0d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:38.783344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:38.793563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498c2f-19e6-4379-9216-a3d5a971bc7a service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:38.822243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:38.857393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:38.858290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:38.858571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:38.858852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] PATH_INFO: `/v3/users/ab7ee0dd49e64323b8bebd9adfca9ca1` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:38.860134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7ee0dd49e64323b8bebd9adfca9ca1)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:38.862112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:38.910783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7ee0dd49e64323b8bebd9adfca9ca1'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.920935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7ee0dd49e64323b8bebd9adfca9ca1'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.921945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7ee0dd49e64323b8bebd9adfca9ca1'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.938123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7ee0dd49e64323b8bebd9adfca9ca1'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.946655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-194c17dd-abf2-4305-9e83-34e826606af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7ee0dd49e64323b8bebd9adfca9ca1'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:38.953752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 996/1960] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:38 2022] DELETE /identity/v3/users/ab7ee0dd49e64323b8bebd9adfca9ca1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:39.280214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.283194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:39.306211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371bd53-4bb9-4c76-ab29-b0c135a2abe2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.453558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.455093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.455468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.455927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] PATH_INFO: `/v3/projects/40d4adc4c87640fa8cafbfe0bb96c479` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.458361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d4adc4c87640fa8cafbfe0bb96c479)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.461133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:39.511542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:39.553055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d4adc4c87640fa8cafbfe0bb96c479', 'request_id': 'req-ed798210-84eb-4ced-83e8-3ec29b39db34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:39.561770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d4adc4c87640fa8cafbfe0bb96c479', 'request_id': 'req-ed798210-84eb-4ced-83e8-3ec29b39db34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:39.569499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d4adc4c87640fa8cafbfe0bb96c479', 'request_id': 'req-ed798210-84eb-4ced-83e8-3ec29b39db34'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:39.582374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] The token cache is being invalidate because project 40d4adc4c87640fa8cafbfe0bb96c479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:39.582809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:39.587819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed798210-84eb-4ced-83e8-3ec29b39db34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:39.591650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 965/1961] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:39 2022] DELETE /identity/v3/projects/40d4adc4c87640fa8cafbfe0bb96c479 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:39.599054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.599352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.599637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.618667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:39.620013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:39.685820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 997/1962] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:39.695064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.695363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.695631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.716458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:39.717838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:39.726172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 966/1963] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:39.730465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.741077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f675d-91c0-45f6-a759-839ded362bd9 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.746187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.746988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.747323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.747577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.748419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:39.749031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.750482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:39.765278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 998/1964] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:39.770065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.779257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e7662-15f6-4bbc-b5e5-56a67fbca6ce None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.784751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.785517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.785797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.786700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.787042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.788980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:39.819830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 967/1965] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:39 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:39.824069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.834659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395345d-5f26-43b6-931e-18746117d91f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.874696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.875713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:39.876763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:39.911900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.912637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.912912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.913194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.913971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.916227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:39.941041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 999/1966] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:39 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:39.942081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.947341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb529411-7e36-42a0-97ca-e262ca83ea2a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.951847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9208b-f7b7-446e-803e-966adfe28f2b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.952317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.953216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.953531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.953805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] PATH_INFO: `/v3/users/3c04ccc4c4994d81a5ee58f9291cb1e1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.955040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c04ccc4c4994d81a5ee58f9291cb1e1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.956463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.957046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:39.957239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.957431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.957715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.958486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.960078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:39.970329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1000/1967] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:39.974575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:39.986983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2a67a-d51e-4447-8dd9-3c85e1b0187c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:39.994116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:39.994931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:39.995243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:39.995533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:39.996311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:39.998227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:40.012777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1001/1968] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:40.017759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:40.018802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c04ccc4c4994d81a5ee58f9291cb1e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.029131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c04ccc4c4994d81a5ee58f9291cb1e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.029864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f2eaf-05a6-45f7-b247-9050c3cf5ad3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:40.036048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356e50c-4ce1-4c5d-989e-ca9ef0ad71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:40.037863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e50c-4ce1-4c5d-989e-ca9ef0ad71a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.038071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e50c-4ce1-4c5d-989e-ca9ef0ad71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.038337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356e50c-4ce1-4c5d-989e-ca9ef0ad71a7 admin admin] PATH_INFO: `/v3/projects/4b9143eb19784ee68d32ba580bc47797/users/9a20070eef754e669bcdbcc83fd44a5c/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.040341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c04ccc4c4994d81a5ee58f9291cb1e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.041312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c04ccc4c4994d81a5ee58f9291cb1e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.057283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e50c-4ce1-4c5d-989e-ca9ef0ad71a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9143eb19784ee68d32ba580bc47797, user_id=9a20070eef754e669bcdbcc83fd44a5c, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:40.060019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356e50c-4ce1-4c5d-989e-ca9ef0ad71a7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:40.066584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5d69680f-2448-443e-94c5-772fbdb72d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c04ccc4c4994d81a5ee58f9291cb1e1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.068756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:40.074785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 968/1969] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:39 2022] DELETE /identity/v3/users/3c04ccc4c4994d81a5ee58f9291cb1e1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:40.087606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.088017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.088297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.095418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1002/1970] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:40 2022] PUT /identity/v3/projects/4b9143eb19784ee68d32ba580bc47797/users/9a20070eef754e669bcdbcc83fd44a5c/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:40.106453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.106802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.107104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.116263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:40.118015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:40.137874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] MFA Rules not processed for user `9a20070eef754e669bcdbcc83fd44a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:40.139092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:40.181810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 969/1971] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:40.191877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:40.193369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:40.216918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1003/1972] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:40.227232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:40.230052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:40.267687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b108d6-e057-493d-ace1-e9a3700719e5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:40.271759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:40.272421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.272719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.272979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.285017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:40.286783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:40.295965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc9ff0-b5c1-4722-9035-c8f83a31a6a7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:40.299640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 970/1973] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:16:40.300053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:40.301043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.301168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.301462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.313171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:40.314988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:40.325861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1004/1974] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:40.733959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:40.736041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:40.760379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b62db-08dd-4db5-aa9a-0996471228e9 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:40.771989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:40.772417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.772703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.777484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] PATH_INFO: `/v3/projects/06025f6a2d4543f79273f9fdbe27b446` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.779498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06025f6a2d4543f79273f9fdbe27b446)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:40.783805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:40.848342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06025f6a2d4543f79273f9fdbe27b446', 'request_id': 'req-8c64c328-7475-4dc6-a91f-1471258d09b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.859117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06025f6a2d4543f79273f9fdbe27b446', 'request_id': 'req-8c64c328-7475-4dc6-a91f-1471258d09b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.866507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06025f6a2d4543f79273f9fdbe27b446', 'request_id': 'req-8c64c328-7475-4dc6-a91f-1471258d09b6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.877938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] The token cache is being invalidate because project 06025f6a2d4543f79273f9fdbe27b446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:40.878228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.879037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:40.880778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 971/1975] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:40 2022] DELETE /identity/v3/projects/06025f6a2d4543f79273f9fdbe27b446 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:40.885277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:40.897232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea64f-117d-40b1-98ee-b5f9d33f8b20 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:40.905865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:40.961032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:40.962012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:40.962296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:40.962576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] PATH_INFO: `/v3/users/f957f0fd02f641aabfea7e28e44770b9` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:40.963845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f957f0fd02f641aabfea7e28e44770b9)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:40.965853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:41.022773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f957f0fd02f641aabfea7e28e44770b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.031286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f957f0fd02f641aabfea7e28e44770b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.032428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f957f0fd02f641aabfea7e28e44770b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.045860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f957f0fd02f641aabfea7e28e44770b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.053956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5b8b5258-0acd-423c-ad60-d0a634e1fdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f957f0fd02f641aabfea7e28e44770b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.060517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1005/1976] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:40 2022] DELETE /identity/v3/users/f957f0fd02f641aabfea7e28e44770b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:41.364594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:41.366310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:41.382395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c328-7475-4dc6-a91f-1471258d09b6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:41.406393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:41.454364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:41.455259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.455544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.455820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] PATH_INFO: `/v3/projects/d26faf95d0f240f9aa9f4ee45715b5fe` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.457047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26faf95d0f240f9aa9f4ee45715b5fe)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:41.459652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:41.511293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26faf95d0f240f9aa9f4ee45715b5fe', 'request_id': 'req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.519715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26faf95d0f240f9aa9f4ee45715b5fe', 'request_id': 'req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.527996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26faf95d0f240f9aa9f4ee45715b5fe', 'request_id': 'req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.542047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] The token cache is being invalidate because project d26faf95d0f240f9aa9f4ee45715b5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:41.542330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.543126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8a3b4d5c-afc9-4ac3-b095-1cb8a440cf45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:41.544779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 972/1977] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:41 2022] DELETE /identity/v3/projects/d26faf95d0f240f9aa9f4ee45715b5fe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:41.549990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.550272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.550564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.570190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:41.571075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:41.648272 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1006/1978] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:41.656680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656516-9528-4072-9870-846c34de43c4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.657362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656516-9528-4072-9870-846c34de43c4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.657646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656516-9528-4072-9870-846c34de43c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.677938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0b656516-9528-4072-9870-846c34de43c4 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:41.679358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0b656516-9528-4072-9870-846c34de43c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:41.690199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 973/1979] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:41.696316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:41.708443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075f1a0-5d7a-4305-afcc-b9f452935e05 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:41.715907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:41.716703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.717103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.717502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.718317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:41.718697 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:41.720526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:41.736760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1007/1980] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:41.741384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656516-9528-4072-9870-846c34de43c4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:41.751469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656516-9528-4072-9870-846c34de43c4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:41.756920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:41.757744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.758092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.758455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.759252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:41.761174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:41.803079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 974/1981] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:41 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:41.807982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:41.820572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6068a-4102-4ce6-99b1-eff65b9a8b5c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:41.836874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:41.889839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:41.890523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.890814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.891086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.891781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:41.893739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:41.919491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1008/1982] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:41 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:41.924067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:41.935550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d6f3-8139-418f-a693-0632ecb002fb admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:41.941872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:41.942570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.942853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.943184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.943977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:41.945651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:41.960463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 975/1983] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:41.962708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:41.978128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684b74c-ead4-46e1-aaec-174510916dd7 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:41.989178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ffb28-2187-4989-b3dd-87010f7590de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:41.990774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ffb28-2187-4989-b3dd-87010f7590de admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:41.991285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ffb28-2187-4989-b3dd-87010f7590de admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:41.991766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ffb28-2187-4989-b3dd-87010f7590de admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:41.992907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ffb28-2187-4989-b3dd-87010f7590de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:41.996075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ffb28-2187-4989-b3dd-87010f7590de admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.017925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1009/1984] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:42.022868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.043117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4169d-93e9-4073-8655-28ff7a0353a7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.050386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.051579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.051976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.052296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] PATH_INFO: `/v3/projects/5a70a85510a44f6082c7e600f7e53bff/users/8034dd93cfd0437d9f4cd84ce79b81a2/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.072686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a70a85510a44f6082c7e600f7e53bff, user_id=8034dd93cfd0437d9f4cd84ce79b81a2, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.075596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.094262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 976/1985] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:42 2022] PUT /identity/v3/projects/5a70a85510a44f6082c7e600f7e53bff/users/8034dd93cfd0437d9f4cd84ce79b81a2/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:42.105899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.106442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.106724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.140236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] MFA Rules not processed for user `8034dd93cfd0437d9f4cd84ce79b81a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:42.141646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:42.214928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1010/1986] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:42.222023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.279608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:42.291942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc294b-988f-470b-b0d0-651e1f18a4af admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.298525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.300455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.300455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.300455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.300741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.302632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.338376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 977/1987] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:42 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:42.342589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.354478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365be792-e533-4154-af8f-8f72cec7a231 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.425298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.426008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.426290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.426570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.427326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.429427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.457823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1011/1988] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:42 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:42.462357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.473589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1841-eb9f-4adb-8c05-c985ac46f3d2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.479743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.480269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.480376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.480686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.481448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.483080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.494761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 978/1989] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:42.499635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.510488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4296d9-5e78-4261-9655-4efa28f4a571 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.518331 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.519736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.520053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.520452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] PATH_INFO: `/v3/projects/4bfdd17ebc7548c78157a5b0d8967e69/users/12b6d4fcf9374a19870835ae5bfeb7f9/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.534702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:42.538760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfdd17ebc7548c78157a5b0d8967e69, user_id=12b6d4fcf9374a19870835ae5bfeb7f9, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.543310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.559751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1012/1990] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:42 2022] PUT /identity/v3/projects/4bfdd17ebc7548c78157a5b0d8967e69/users/12b6d4fcf9374a19870835ae5bfeb7f9/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:42.563982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.574523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44f94-31d4-40cc-a104-a4df3b5ffbae admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.641894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2894e-acfe-490a-a0a4-590063923cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.642884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2894e-acfe-490a-a0a4-590063923cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.643291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2894e-acfe-490a-a0a4-590063923cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.643628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2894e-acfe-490a-a0a4-590063923cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.644804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2894e-acfe-490a-a0a4-590063923cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.647170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2894e-acfe-490a-a0a4-590063923cc4 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.659540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 979/1991] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:42.664418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.675913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c452e1-6935-4375-adfe-dbca12c82fdd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.681664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.682591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.682885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.683162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] PATH_INFO: `/v3/projects/4bfdd17ebc7548c78157a5b0d8967e69/users/12b6d4fcf9374a19870835ae5bfeb7f9/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.685225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfdd17ebc7548c78157a5b0d8967e69, user_id=12b6d4fcf9374a19870835ae5bfeb7f9, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.687925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.698867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1013/1992] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:42 2022] PUT /identity/v3/projects/4bfdd17ebc7548c78157a5b0d8967e69/users/12b6d4fcf9374a19870835ae5bfeb7f9/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:42.710179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.710673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.711069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.750292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] MFA Rules not processed for user `12b6d4fcf9374a19870835ae5bfeb7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:42.752072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:42.831908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 980/1993] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:42.843755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:42.845523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:42.914782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614ae01-e8ac-4cb7-9cfd-1a039889e856 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:42.918671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb1023-116b-402a-b0d3-b53dfc4610cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:42.919502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1023-116b-402a-b0d3-b53dfc4610cb service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:42.919601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1023-116b-402a-b0d3-b53dfc4610cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:42.919925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb1023-116b-402a-b0d3-b53dfc4610cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:42.932349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb1023-116b-402a-b0d3-b53dfc4610cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:42.933850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb1023-116b-402a-b0d3-b53dfc4610cb service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:42.945257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1014/1994] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:42.987963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:43.046282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:43.067404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9daea-94a3-4f69-aafc-ea1fa500d967 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:43.074186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:43.075096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:43.075366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:43.075635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] PATH_INFO: `/v3/users/8034dd93cfd0437d9f4cd84ce79b81a2` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:43.077001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8034dd93cfd0437d9f4cd84ce79b81a2)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:43.079017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:43.153547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8034dd93cfd0437d9f4cd84ce79b81a2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:43.165632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8034dd93cfd0437d9f4cd84ce79b81a2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:43.181441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8034dd93cfd0437d9f4cd84ce79b81a2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:43.183258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8034dd93cfd0437d9f4cd84ce79b81a2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:43.219109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8034dd93cfd0437d9f4cd84ce79b81a2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:43.234307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 981/1995] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:42 2022] DELETE /identity/v3/users/8034dd93cfd0437d9f4cd84ce79b81a2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:43.239687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7740db-be72-4bed-b375-07ff3147a0aa None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:43.241428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7740db-be72-4bed-b375-07ff3147a0aa None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:43.241428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7740db-be72-4bed-b375-07ff3147a0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:43.273504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4c7740db-be72-4bed-b375-07ff3147a0aa None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:43.273504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4c7740db-be72-4bed-b375-07ff3147a0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:43.365385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1015/1996] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:43.373294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:43.374751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:43.470421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300020a-3b70-40a1-b3bc-b15f2c58062d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:43.475665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:43.477284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:43.477284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:43.477284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:43.494813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:43.496376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:43.509353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 982/1997] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:43.885536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:43.885870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:43.886103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:43.894654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:43.896180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:43.909974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ad9d1-667a-4410-b87b-4feaeeefa9c7 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:43.915942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] MFA Rules not processed for user `9a20070eef754e669bcdbcc83fd44a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:43.917148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:43.920115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:43.921090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:43.921462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:43.921823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] PATH_INFO: `/v3/projects/5a70a85510a44f6082c7e600f7e53bff` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:43.923447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a70a85510a44f6082c7e600f7e53bff)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:43.926064 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:43.978706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a70a85510a44f6082c7e600f7e53bff', 'request_id': 'req-7ff67d80-f30a-4165-81e3-febfbc342671'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:43.985102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1016/1998] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:43.993883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a70a85510a44f6082c7e600f7e53bff', 'request_id': 'req-7ff67d80-f30a-4165-81e3-febfbc342671'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.000986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a70a85510a44f6082c7e600f7e53bff', 'request_id': 'req-7ff67d80-f30a-4165-81e3-febfbc342671'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.003123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:44.020699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] The token cache is being invalidate because project 5a70a85510a44f6082c7e600f7e53bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:44.020950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.021743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.024414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 983/1999] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:43 2022] DELETE /identity/v3/projects/5a70a85510a44f6082c7e600f7e53bff => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:44.028611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:44.053704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a953004-8b5b-4db0-9ff8-6c0ac0107590 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:44.090454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:44.149253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:44.153087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:44.153669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:44.154046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] PATH_INFO: `/v3/users/12b6d4fcf9374a19870835ae5bfeb7f9` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:44.155593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b6d4fcf9374a19870835ae5bfeb7f9)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:44.158425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:44.236007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b6d4fcf9374a19870835ae5bfeb7f9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.245989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b6d4fcf9374a19870835ae5bfeb7f9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.247072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b6d4fcf9374a19870835ae5bfeb7f9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.268275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b6d4fcf9374a19870835ae5bfeb7f9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.279348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d6e2be5b-4aec-4559-b450-0efe2d4d25b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b6d4fcf9374a19870835ae5bfeb7f9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.289081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1017/2000] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:44 2022] DELETE /identity/v3/users/12b6d4fcf9374a19870835ae5bfeb7f9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:44.757765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:44.759832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:44.788080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff67d80-f30a-4165-81e3-febfbc342671 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:44.899600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:44.900675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:44.901018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:44.901439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] PATH_INFO: `/v3/projects/4bfdd17ebc7548c78157a5b0d8967e69` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:44.902892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfdd17ebc7548c78157a5b0d8967e69)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:44.905259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:44.964361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfdd17ebc7548c78157a5b0d8967e69', 'request_id': 'req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.973051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfdd17ebc7548c78157a5b0d8967e69', 'request_id': 'req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.980067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfdd17ebc7548c78157a5b0d8967e69', 'request_id': 'req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.993204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] The token cache is being invalidate because project 4bfdd17ebc7548c78157a5b0d8967e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:44.993533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.994372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b7a75a64-c6dd-48a9-8a12-d69e33ac1748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:44.996007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 984/2001] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:44 2022] DELETE /identity/v3/projects/4bfdd17ebc7548c78157a5b0d8967e69 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:45.002967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.003656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.004222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.026029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:45.027379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:45.103626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1018/2002] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:45.111392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.111706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.111989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.132077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:45.133611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:45.143404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 985/2003] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:45.147762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.158801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16313dd3-2507-4a8d-98b0-168d6bfc07a0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.164411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.165419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.165705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.165981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.166950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:45.167153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.168778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.184673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1019/2004] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:16:45.189238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.200296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608939dd-38f2-41c4-a06a-dedd239fada8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.205103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.205912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.206174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.206449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.207153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.209177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.243288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 986/2005] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:45.247693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.260287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2c6d5-995b-47e3-a7c6-68274cd8d719 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.297447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:45.331122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.331826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.332081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.332519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.333434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.335637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.361030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1020/2006] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:45.365599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.376239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08b1f3-c961-4365-b027-e8a46e08d515 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.384120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.385312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.385636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.385914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.386669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.388470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.400442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 987/2007] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:45.404559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.415187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fce40-2ab8-4d36-8779-5dedd2c0df66 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.420031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdcd0f-b927-4824-bdf9-c8789b50e09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.420738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcd0f-b927-4824-bdf9-c8789b50e09b admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.421028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcd0f-b927-4824-bdf9-c8789b50e09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.421314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdcd0f-b927-4824-bdf9-c8789b50e09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.422103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdcd0f-b927-4824-bdf9-c8789b50e09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.423782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdcd0f-b927-4824-bdf9-c8789b50e09b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.435351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1021/2008] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:45.439613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.450979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fc1a6-2324-46f5-a268-74ff32c0b681 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.456424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.457368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.457661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.457943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] PATH_INFO: `/v3/projects/2917c0375f30479cae5ff5740276a5bd/users/cd1b4ddc2c494e8e881c9975ef5bfd3d/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.476597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2917c0375f30479cae5ff5740276a5bd, user_id=cd1b4ddc2c494e8e881c9975ef5bfd3d, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.479384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.497796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 988/2009] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:45 2022] PUT /identity/v3/projects/2917c0375f30479cae5ff5740276a5bd/users/cd1b4ddc2c494e8e881c9975ef5bfd3d/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:45.510198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.510492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.510839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.543088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] MFA Rules not processed for user `cd1b4ddc2c494e8e881c9975ef5bfd3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:45.544361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:45.634918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1022/2010] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:45.639436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.668075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:45.740177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb110747-5d10-422c-a795-c987201e8e3d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.748948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.750216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.750690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.751163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.752271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.755330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.808397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 989/2011] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:45.812821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:45.831185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dc58d-b970-46b7-b6aa-105c7f85384a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:45.941672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:45.942820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:45.943243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:45.943596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:45.945043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:45.947502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:45.984616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1023/2012] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:45 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:16:45.996017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:46.017065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd8e3-68b1-47d4-b51d-e50998ce1c34 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:46.033610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:46.034460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.034748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.035021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.035914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:46.037666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:46.063247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 990/2013] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:46.064827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:46.078027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dccffd-a38a-4332-9d12-77daa35d4cd5 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:46.088833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:46.090802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.091500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.092107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] PATH_INFO: `/v3/projects/709ceb7bb0a3493e8e73f3cc6e882f45/users/7901761423b047f586195898aac7a77b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.121211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ceb7bb0a3493e8e73f3cc6e882f45, user_id=7901761423b047f586195898aac7a77b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:46.124093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:46.141705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1024/2014] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:46 2022] PUT /identity/v3/projects/709ceb7bb0a3493e8e73f3cc6e882f45/users/7901761423b047f586195898aac7a77b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:46.145722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:46.167282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58aa92-e1dc-4638-abe7-7bcc4b7097df admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:46.251317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410902-3ff2-4f16-9161-c282801ddfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:46.252207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410902-3ff2-4f16-9161-c282801ddfcb admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.252759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410902-3ff2-4f16-9161-c282801ddfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.253091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410902-3ff2-4f16-9161-c282801ddfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.253907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410902-3ff2-4f16-9161-c282801ddfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:46.255789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410902-3ff2-4f16-9161-c282801ddfcb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:46.273382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 991/2015] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:16:46.276666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:46.291630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6fd92-4764-471f-b7a0-76307f27a615 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:46.297924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:46.298955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.299295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.299628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] PATH_INFO: `/v3/projects/709ceb7bb0a3493e8e73f3cc6e882f45/users/7901761423b047f586195898aac7a77b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.302030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ceb7bb0a3493e8e73f3cc6e882f45, user_id=7901761423b047f586195898aac7a77b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:46.305738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:46.308318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:46.319643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1025/2016] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:46 2022] PUT /identity/v3/projects/709ceb7bb0a3493e8e73f3cc6e882f45/users/7901761423b047f586195898aac7a77b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:46.329996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.330292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.331479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.358270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] MFA Rules not processed for user `7901761423b047f586195898aac7a77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:46.359480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:46.461647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 992/2017] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:46.473984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:46.476025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:46.557456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244b7de-ef15-4341-a096-a86f36a83ded admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:46.564839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:46.565727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.566132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.566501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.578332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:46.579789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:46.593725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1026/2018] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:46.677742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:46.693651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc44fc1-fb7b-4f26-874f-7b824b38b7fa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:46.697643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70666a-f2f2-4452-a03e-c052db3108ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:46.698316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70666a-f2f2-4452-a03e-c052db3108ce service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:46.698600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70666a-f2f2-4452-a03e-c052db3108ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:46.698924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70666a-f2f2-4452-a03e-c052db3108ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:46.711789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:46.773664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70666a-f2f2-4452-a03e-c052db3108ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:46.775154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70666a-f2f2-4452-a03e-c052db3108ce service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:46.786537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 993/2019] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:55.858589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:55.963933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd67ca5-cab4-4cf8-bb9b-8bc23c66017f service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:55.970831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:55.971763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:55.972042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:55.972317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] PATH_INFO: `/v3/users/cd1b4ddc2c494e8e881c9975ef5bfd3d` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:55.973608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1b4ddc2c494e8e881c9975ef5bfd3d)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:55.975594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:56.035862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1b4ddc2c494e8e881c9975ef5bfd3d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:56.044551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1b4ddc2c494e8e881c9975ef5bfd3d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:56.045216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1b4ddc2c494e8e881c9975ef5bfd3d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:56.060728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1b4ddc2c494e8e881c9975ef5bfd3d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:56.068468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1b4ddc2c494e8e881c9975ef5bfd3d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:56.076202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1027/2020] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:55 2022] DELETE /identity/v3/users/cd1b4ddc2c494e8e881c9975ef5bfd3d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:56.080968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:56.081528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:56.081626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:56.111799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:56.113220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:56.178625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 994/2021] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:56.189554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:56.191302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:56.213358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:56.266849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9497469-befe-41a7-bb33-1fbde533643e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:56.271117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:56.271610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:56.271901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:56.272178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:56.282888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:56.284453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:56.295074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1028/2022] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:56.863276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:56.864920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:56.883619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84347a8-d5b5-4f0a-b6c0-4229dd0de903 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:56.888716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:56.889780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:56.890140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:56.890535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] PATH_INFO: `/v3/projects/2917c0375f30479cae5ff5740276a5bd` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:56.892167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2917c0375f30479cae5ff5740276a5bd)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:56.900210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:56.988953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2917c0375f30479cae5ff5740276a5bd', 'request_id': 'req-ad17fc57-d94c-403b-91d3-5e007624b544'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.005286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2917c0375f30479cae5ff5740276a5bd', 'request_id': 'req-ad17fc57-d94c-403b-91d3-5e007624b544'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.015091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2917c0375f30479cae5ff5740276a5bd', 'request_id': 'req-ad17fc57-d94c-403b-91d3-5e007624b544'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.027273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] The token cache is being invalidate because project 2917c0375f30479cae5ff5740276a5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:57.027548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.028927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.033580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 995/2023] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:56 2022] DELETE /identity/v3/projects/2917c0375f30479cae5ff5740276a5bd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:57.045365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:57.067444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c77c-ebef-401f-aad2-f830bae54533 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:57.138876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:57.139790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:57.140073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:57.140350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] PATH_INFO: `/v3/users/7901761423b047f586195898aac7a77b` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:57.141645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7901761423b047f586195898aac7a77b)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:57.143872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:57.219165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7901761423b047f586195898aac7a77b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.227865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7901761423b047f586195898aac7a77b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.228523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7901761423b047f586195898aac7a77b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.246038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7901761423b047f586195898aac7a77b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.255590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-e07076f0-0995-489a-b773-e0cdc92b2746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7901761423b047f586195898aac7a77b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.264770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1029/2024] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:57 2022] DELETE /identity/v3/users/7901761423b047f586195898aac7a77b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:57.599906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:57.601732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:57.615931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17fc57-d94c-403b-91d3-5e007624b544 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:57.660426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:57.694569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:57.697625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:57.697625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:57.697625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] PATH_INFO: `/v3/projects/709ceb7bb0a3493e8e73f3cc6e882f45` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:57.698649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709ceb7bb0a3493e8e73f3cc6e882f45)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:57.700899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:57.759061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709ceb7bb0a3493e8e73f3cc6e882f45', 'request_id': 'req-45e7c43e-6650-4365-9466-8e90f54c6c12'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.768354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709ceb7bb0a3493e8e73f3cc6e882f45', 'request_id': 'req-45e7c43e-6650-4365-9466-8e90f54c6c12'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.775337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709ceb7bb0a3493e8e73f3cc6e882f45', 'request_id': 'req-45e7c43e-6650-4365-9466-8e90f54c6c12'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.786565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] The token cache is being invalidate because project 709ceb7bb0a3493e8e73f3cc6e882f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:57.786881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.787621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-45e7c43e-6650-4365-9466-8e90f54c6c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:57.789243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 996/2025] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:57 2022] DELETE /identity/v3/projects/709ceb7bb0a3493e8e73f3cc6e882f45 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:57.794434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:57.794723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:57.795007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:57.814248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:57.815586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:57.852555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:57.891742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1030/2026] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:57.900778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:57.901067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:57.901392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:57.923014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:57.924723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:57.934681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 997/2027] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:57.939832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:57.952770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca5ee8-a96e-49de-abd0-d587885db23b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:57.957650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:57.958332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:57.958610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:57.958890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:57.959610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:16:57.959913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:57.961566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:57.975696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1031/2028] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:16:57.980721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:57.991143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109f043-bb75-47d6-8e74-45df0202369c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:57.996215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:57.997509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:57.997802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:57.998068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:57.998765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.000667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.039242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 998/2029] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:16:57 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:58.040604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.055293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6215eee-237b-41f2-b134-3897f015c2c0 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.155593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.155995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.156350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.156686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.161155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.161155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.193505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1032/2030] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:16:58 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:16:58.198558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.226825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e391-6ed0-4e67-a969-bc10a8664cd9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.236555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.238249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.238683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.239093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.241916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.243830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.270671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 999/2031] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:58.275201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.296292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702f46a-725d-45e6-8e30-6042cafbe3b8 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.301016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7f334-89b0-404c-b8b7-78b6d24a620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.302078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f334-89b0-404c-b8b7-78b6d24a620e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.302363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f334-89b0-404c-b8b7-78b6d24a620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.303407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7f334-89b0-404c-b8b7-78b6d24a620e admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.304181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7f334-89b0-404c-b8b7-78b6d24a620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.306172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7f334-89b0-404c-b8b7-78b6d24a620e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.319876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1033/2032] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:16:58.325095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.339900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef713c31-c4b2-456d-a643-6952aabf64a6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.347471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.350783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.350783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.350783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] PATH_INFO: `/v3/projects/af65526047c249468d0a84a423567d04/users/13f631b261824600bfc7e6c1b4433e2d/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.374551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af65526047c249468d0a84a423567d04, user_id=13f631b261824600bfc7e6c1b4433e2d, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.378768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.409890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1000/2033] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:16:58 2022] PUT /identity/v3/projects/af65526047c249468d0a84a423567d04/users/13f631b261824600bfc7e6c1b4433e2d/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:58.423152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.423731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.424997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.462682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] MFA Rules not processed for user `13f631b261824600bfc7e6c1b4433e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:58.463412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:58.492937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.494847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:58.565569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1034/2034] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:16:58.577989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.579718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:58.585786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae17831-cf03-4857-b2f8-b905751f3ef7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.597590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.598834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.599332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.599985 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] PATH_INFO: `/v3/users/a7254b0ceb27442083110bc34796c148` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.601314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7254b0ceb27442083110bc34796c148)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.603413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.606603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:58.635325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:58.672971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7254b0ceb27442083110bc34796c148'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:58.674684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e52c8a-eb83-469f-8390-1f53158794cc None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.681755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9893787-8953-48f2-9488-53a91a057359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.682630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9893787-8953-48f2-9488-53a91a057359 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.682976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9893787-8953-48f2-9488-53a91a057359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.683176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9893787-8953-48f2-9488-53a91a057359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.693439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9893787-8953-48f2-9488-53a91a057359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.695151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9893787-8953-48f2-9488-53a91a057359 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.695833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7254b0ceb27442083110bc34796c148'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:58.705786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1035/2035] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:58.709867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7254b0ceb27442083110bc34796c148'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:58.710610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7254b0ceb27442083110bc34796c148'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:58.727091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7254b0ceb27442083110bc34796c148'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:58.737284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1001/2036] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:58 2022] DELETE /identity/v3/users/a7254b0ceb27442083110bc34796c148 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:16:58.741511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.741771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.742049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.761254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:16:58.763467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:58.834062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1036/2037] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:16:58.846094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:58.848633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:58.925970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632973d5-c556-4ef2-bfdb-7f1142e6f3a6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:58.929825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:58.931365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:58.931365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:58.931365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:58.953796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:58.956240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:58.970922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1002/2038] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:16:59.343780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:59.345353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:16:59.359067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fde8f-98da-4ea9-b4bf-034119d60182 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:59.365218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:59.366294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:59.367200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:59.367518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] PATH_INFO: `/v3/projects/2c6c3a05eb0a4e60bb8cdadfeae7ecf0` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:59.369097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6c3a05eb0a4e60bb8cdadfeae7ecf0)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:59.371436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:59.446031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6c3a05eb0a4e60bb8cdadfeae7ecf0', 'request_id': 'req-9971cd26-6acc-49a8-89a3-9e44a5247c7f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.461721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6c3a05eb0a4e60bb8cdadfeae7ecf0', 'request_id': 'req-9971cd26-6acc-49a8-89a3-9e44a5247c7f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.476299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6c3a05eb0a4e60bb8cdadfeae7ecf0', 'request_id': 'req-9971cd26-6acc-49a8-89a3-9e44a5247c7f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.498337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] The token cache is being invalidate because project 2c6c3a05eb0a4e60bb8cdadfeae7ecf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:16:59.498759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.499498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.501523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1037/2039] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:16:59 2022] DELETE /identity/v3/projects/2c6c3a05eb0a4e60bb8cdadfeae7ecf0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:16:59.505788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:16:59.524637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928d97-9b31-490f-a7f0-5fa3ec620f82 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:16:59.591164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:16:59.592082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:16:59.592367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:16:59.592640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] PATH_INFO: `/v3/users/4b8d9dce157a4f3cbfa1a7295704a4c0` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:16:59.594170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b8d9dce157a4f3cbfa1a7295704a4c0)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:16:59.596573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:16:59.632727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:16:59.658397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b8d9dce157a4f3cbfa1a7295704a4c0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.668151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b8d9dce157a4f3cbfa1a7295704a4c0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.677115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b8d9dce157a4f3cbfa1a7295704a4c0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.678015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b8d9dce157a4f3cbfa1a7295704a4c0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.693223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6c9fc664-7b22-41aa-a2d2-5cb7f9f12631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b8d9dce157a4f3cbfa1a7295704a4c0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:16:59.700257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1003/2040] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:16:59 2022] DELETE /identity/v3/users/4b8d9dce157a4f3cbfa1a7295704a4c0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:00.023181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.024954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:00.042263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971cd26-6acc-49a8-89a3-9e44a5247c7f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.116254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.117362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.117689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.117968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] PATH_INFO: `/v3/projects/4bd6f995e50741fbba1101e6f343effa` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.119478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd6f995e50741fbba1101e6f343effa)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.121783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:00.123970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:00.187802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd6f995e50741fbba1101e6f343effa', 'request_id': 'req-8b859bcd-af3b-40d7-9909-7866060c1582'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:00.200843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd6f995e50741fbba1101e6f343effa', 'request_id': 'req-8b859bcd-af3b-40d7-9909-7866060c1582'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:00.206226 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd6f995e50741fbba1101e6f343effa', 'request_id': 'req-8b859bcd-af3b-40d7-9909-7866060c1582'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:00.224471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] The token cache is being invalidate because project 4bd6f995e50741fbba1101e6f343effa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:00.225055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:00.226004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8b859bcd-af3b-40d7-9909-7866060c1582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:00.231435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1038/2041] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:00 2022] DELETE /identity/v3/projects/4bd6f995e50741fbba1101e6f343effa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:00.233540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.233832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.234106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.269386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:00.271061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:00.390973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1004/2042] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:00.399120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.399556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.399662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.426848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:00.428088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:00.440432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1039/2043] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:00.441285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.457004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb8af8-bfa8-499e-a69c-6e624704b173 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.464647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.465812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.466271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.466944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.467830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:00.468582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.471982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:00.496490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1005/2044] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:00.501485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.512812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063b38-613f-487a-b9d7-e916bab44acb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.518416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.520278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.520784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.521249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.523441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.526602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:00.584582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1040/2045] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:00 2022] POST /identity/v3/projects => generated 355 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:00.588994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.602293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdd10-2d87-49d9-b943-8042ba8508a2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.722115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.723746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.724476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.725048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.726853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.731194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:00.777012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1006/2046] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:00 2022] POST /identity/v3/users => generated 278 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:00.777878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.792046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52e1c-7e69-4056-851c-af0c37a13a5b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.799202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.800277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.800556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.800835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.801655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.803294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:00.818534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1041/2047] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:00.825550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.858768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb68868-d1c3-4869-a307-c9f949e43074 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.867567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d30e93-ae5e-4088-aaa9-a32834872b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.868982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d30e93-ae5e-4088-aaa9-a32834872b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.869630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d30e93-ae5e-4088-aaa9-a32834872b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.870106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d30e93-ae5e-4088-aaa9-a32834872b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.871384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d30e93-ae5e-4088-aaa9-a32834872b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.873623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d30e93-ae5e-4088-aaa9-a32834872b37 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:00.897584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1007/2048] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:00.904607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:00.926576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e2888-0a00-4e74-8523-1da38d9de3f0 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:00.935051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:00.938514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:00.939006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:00.939445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] PATH_INFO: `/v3/projects/9c69fde155f34fd5a48e916b85a87bf2/users/4ed4f9b918ed45c8a7f8d135b4a84e41/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:00.985505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c69fde155f34fd5a48e916b85a87bf2, user_id=4ed4f9b918ed45c8a7f8d135b4a84e41, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:00.988972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.006682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1042/2049] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:00 2022] PUT /identity/v3/projects/9c69fde155f34fd5a48e916b85a87bf2/users/4ed4f9b918ed45c8a7f8d135b4a84e41/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:01.021215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.021721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.022112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.061409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:01.073682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] MFA Rules not processed for user `4ed4f9b918ed45c8a7f8d135b4a84e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:01.075358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:01.176440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1008/2050] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:01.181582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.295104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866def03-a07f-4b7e-acce-9e07bf89949b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:01.300756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:01.301681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.301962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.302236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.302966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:01.304964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.356731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1043/2051] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:01 2022] POST /identity/v3/projects => generated 357 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:01.361023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.384650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6d6ac-afa3-48d1-8dc1-8bb706de6353 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:01.515659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:01.516520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.516907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.517953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.518226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:01.520500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.562913 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1009/2052] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:01 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:01.566068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.578698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50185b-241c-4a0e-b180-050479de9ed2 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:01.585043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:01.586131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.586444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.586680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.587443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:01.589769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.595537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:01.607339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1044/2053] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:01.608376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.619652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56bf0e-e62d-4310-bc92-a555cf6fd571 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:01.627136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:01.628269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.628683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.629211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] PATH_INFO: `/v3/projects/1ff7e768960d4cdeb223baa24da9c8ef/users/5ddc8df9e59e4b078167ace69f84ef5c/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.648795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff7e768960d4cdeb223baa24da9c8ef, user_id=5ddc8df9e59e4b078167ace69f84ef5c, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:01.652152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.674258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1010/2054] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:01 2022] PUT /identity/v3/projects/1ff7e768960d4cdeb223baa24da9c8ef/users/5ddc8df9e59e4b078167ace69f84ef5c/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:01.678815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.689928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958641e9-94ee-4112-896a-734fe3aee675 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:01.759687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205dc4c-2a49-4215-98a6-24280f658e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:01.760285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205dc4c-2a49-4215-98a6-24280f658e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.760578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205dc4c-2a49-4215-98a6-24280f658e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.760855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205dc4c-2a49-4215-98a6-24280f658e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.761638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205dc4c-2a49-4215-98a6-24280f658e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:01.763812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205dc4c-2a49-4215-98a6-24280f658e46 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.775339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1045/2055] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:01.782416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.798990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fc745-e293-4445-b6f3-1647ef64143c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:01.804939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:01.805898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.806185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.806458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] PATH_INFO: `/v3/projects/1ff7e768960d4cdeb223baa24da9c8ef/users/5ddc8df9e59e4b078167ace69f84ef5c/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.808675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff7e768960d4cdeb223baa24da9c8ef, user_id=5ddc8df9e59e4b078167ace69f84ef5c, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:01.811758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:01.823621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1011/2056] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:01 2022] PUT /identity/v3/projects/1ff7e768960d4cdeb223baa24da9c8ef/users/5ddc8df9e59e4b078167ace69f84ef5c/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:01.835175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:01.835491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:01.835768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:01.864863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] MFA Rules not processed for user `5ddc8df9e59e4b078167ace69f84ef5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:01.866298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:01.971051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1046/2057] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:01.980550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:01.984933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:02.080523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2da9-50f7-43b4-8ba7-0d4d38b1e038 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:02.086380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:02.087627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:02.088127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:02.088618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:02.101471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:02.108327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:02.109850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:02.121580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1012/2058] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:01 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:02.217557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:02.219191 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:02.229644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:02.232117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:02.242287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740659fa-d254-4dad-a4b0-5e85b4501a2f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:02.249245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7da1-9566-4ef1-8def-d0f518c01fed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:02.250407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7da1-9566-4ef1-8def-d0f518c01fed service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:02.250766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7da1-9566-4ef1-8def-d0f518c01fed service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:02.251223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7da1-9566-4ef1-8def-d0f518c01fed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:02.329609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3e612-d920-497d-9054-49d1d7feb6d8 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:02.334905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:02.335827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:02.336114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:02.336385 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] PATH_INFO: `/v3/users/13f631b261824600bfc7e6c1b4433e2d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:02.337969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f631b261824600bfc7e6c1b4433e2d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:02.340014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:02.364833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7da1-9566-4ef1-8def-d0f518c01fed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:02.367449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7da1-9566-4ef1-8def-d0f518c01fed service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:02.386325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1047/2059] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:02 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:02.422346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f631b261824600bfc7e6c1b4433e2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:02.435930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f631b261824600bfc7e6c1b4433e2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:02.455268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f631b261824600bfc7e6c1b4433e2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:02.456369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f631b261824600bfc7e6c1b4433e2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:02.485403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f631b261824600bfc7e6c1b4433e2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:02.492602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1013/2060] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:02 2022] DELETE /identity/v3/users/13f631b261824600bfc7e6c1b4433e2d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:02.500243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:02.501096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:02.502594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:02.551516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:02.553268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:02.579266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:02.698590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1048/2061] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:02.712741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:02.714891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:02.823226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae938-f015-4bc3-ab5e-c41b896c7e0f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:02.827371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3ecb2-966e-40df-8542-03092102c286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:02.828194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ecb2-966e-40df-8542-03092102c286 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:02.828472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ecb2-966e-40df-8542-03092102c286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:02.828744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ecb2-966e-40df-8542-03092102c286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:02.841939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3ecb2-966e-40df-8542-03092102c286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:02.844808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3ecb2-966e-40df-8542-03092102c286 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:02.856806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1014/2062] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:03.269190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.271382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:03.297791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedafd59-a378-420b-836a-5bca4fc1a2a0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.308793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.309801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.310100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.310380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] PATH_INFO: `/v3/projects/af65526047c249468d0a84a423567d04` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.314047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af65526047c249468d0a84a423567d04)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:03.316030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:03.410752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af65526047c249468d0a84a423567d04', 'request_id': 'req-a338b847-1c32-472f-b76d-a156b4dc3b46'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:03.419778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af65526047c249468d0a84a423567d04', 'request_id': 'req-a338b847-1c32-472f-b76d-a156b4dc3b46'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:03.431517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af65526047c249468d0a84a423567d04', 'request_id': 'req-a338b847-1c32-472f-b76d-a156b4dc3b46'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:03.478818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] The token cache is being invalidate because project af65526047c249468d0a84a423567d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:03.479111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:03.480146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a338b847-1c32-472f-b76d-a156b4dc3b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:03.485407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1049/2063] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:03 2022] DELETE /identity/v3/projects/af65526047c249468d0a84a423567d04 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:03.490143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.490457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.490908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.511171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:03.513257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:03.524850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:03.590881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1015/2064] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:03.600828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886394f-0a1e-402c-a510-03195813390c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.601412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886394f-0a1e-402c-a510-03195813390c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.601759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886394f-0a1e-402c-a510-03195813390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.624329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1886394f-0a1e-402c-a510-03195813390c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:03.625654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1886394f-0a1e-402c-a510-03195813390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:03.634388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1050/2065] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:03.639518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.650251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4973ac-aae3-472e-bf98-936948a2dd6e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.656323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.659669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.659669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.659669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.660213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:03.660639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:03.662641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:03.681455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1016/2066] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:03.682433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886394f-0a1e-402c-a510-03195813390c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.694544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886394f-0a1e-402c-a510-03195813390c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.703331 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.704119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.704320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.704599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.705302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:03.707346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:03.740079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1051/2067] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:03 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:03.743189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.757440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696266cb-681c-401e-922a-028e90e9507f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.853783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.854795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.854795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.855200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.856241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:03.858185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:03.884157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1017/2068] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:03 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:03.889207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.900017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46838c40-d77c-4ca2-9c5b-ef039e7446ab admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.905017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.905755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.906039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.906320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.907468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:03.909247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:03.926199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1052/2069] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:03.929682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.945470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c489c-1391-4a85-941a-c7bd4ae47da9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.951234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89194-09ef-404f-946b-6be81272658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.952036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89194-09ef-404f-946b-6be81272658e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.952315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89194-09ef-404f-946b-6be81272658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.952484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89194-09ef-404f-946b-6be81272658e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:03.953270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89194-09ef-404f-946b-6be81272658e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:03.954882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89194-09ef-404f-946b-6be81272658e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:03.968095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1018/2070] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:03.973763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:03.984888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc0239-7c85-4ef7-ae42-b398c857171c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:03.990097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:03.991100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:03.991460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:03.991776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] PATH_INFO: `/v3/projects/f8635efdd4ea406eabfb397bdfd83d07/users/3955b4cf3ef54207b09d7008906221e7/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:04.009626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8635efdd4ea406eabfb397bdfd83d07, user_id=3955b4cf3ef54207b09d7008906221e7, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:04.012472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:04.029758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1053/2071] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:03 2022] PUT /identity/v3/projects/f8635efdd4ea406eabfb397bdfd83d07/users/3955b4cf3ef54207b09d7008906221e7/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:04.035480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70fb7d-88c2-408c-be57-593baae3431a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:04.035773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70fb7d-88c2-408c-be57-593baae3431a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:04.036021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70fb7d-88c2-408c-be57-593baae3431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:04.056128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3b70fb7d-88c2-408c-be57-593baae3431a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:04.057336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3b70fb7d-88c2-408c-be57-593baae3431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:04.145953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1019/2072] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:04.156530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:04.158966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:04.219353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:04.238274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d51b02-dcd6-4bb7-b31e-b5cf26d48037 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:04.243813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:04.245221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:04.245716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:04.246219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:04.260096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:04.261947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:04.274779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1054/2073] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:05.952388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e479e-af44-4083-b089-76f77fa1c663 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:05.952988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e479e-af44-4083-b089-76f77fa1c663 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:05.952988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e479e-af44-4083-b089-76f77fa1c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:05.995213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a39e479e-af44-4083-b089-76f77fa1c663 None None] MFA Rules not processed for user `3955b4cf3ef54207b09d7008906221e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:05.996650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a39e479e-af44-4083-b089-76f77fa1c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:06.010472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:06.088933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1020/2074] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:06.103106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:06.105579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:06.176019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ee68a-f00f-4f64-8aa3-f272f856d197 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:06.179984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906b1c5-d73b-4ca1-98ba-1ab0394c1e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:06.180853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906b1c5-d73b-4ca1-98ba-1ab0394c1e15 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:06.181203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906b1c5-d73b-4ca1-98ba-1ab0394c1e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:06.181609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906b1c5-d73b-4ca1-98ba-1ab0394c1e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:06.191490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906b1c5-d73b-4ca1-98ba-1ab0394c1e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:06.192892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906b1c5-d73b-4ca1-98ba-1ab0394c1e15 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:06.206221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1055/2075] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:09.319201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d2da-4b7e-4fb1-adfa-08b267f6378b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:09.319736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d2da-4b7e-4fb1-adfa-08b267f6378b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:09.319959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51d2da-4b7e-4fb1-adfa-08b267f6378b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:09.321742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1021/2076] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:17:09.334403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:09.335266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:09.335590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:09.356771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] MFA Rules not processed for user `f07fe125a6a7414b9f2702cb75bf681e`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:09.358013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:09.397237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d2da-4b7e-4fb1-adfa-08b267f6378b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:09.399454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4d51d2da-4b7e-4fb1-adfa-08b267f6378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:09.419149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51d2da-4b7e-4fb1-adfa-08b267f6378b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:09.423918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:09.425066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:09.425417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:09.425704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] PATH_INFO: `/v3/users/5fd1bd3a55de406d9f4b2adf35bef024` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:09.426937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd1bd3a55de406d9f4b2adf35bef024)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:09.428920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:09.466663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1056/2077] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:17:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:09.481645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:09.483247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:09.492288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd1bd3a55de406d9f4b2adf35bef024'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.497645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c51d-d28c-426d-b90f-fd0cd3ecf629 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:09.503608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd1bd3a55de406d9f4b2adf35bef024'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.511925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd1bd3a55de406d9f4b2adf35bef024'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.512923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd1bd3a55de406d9f4b2adf35bef024'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.514937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0aa713-8c51-4fb6-82be-f3f9e0effa93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:09.529799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0aa713-8c51-4fb6-82be-f3f9e0effa93 service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:09.530117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0aa713-8c51-4fb6-82be-f3f9e0effa93 service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:09.530403 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0aa713-8c51-4fb6-82be-f3f9e0effa93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:09.532105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd1bd3a55de406d9f4b2adf35bef024'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.538448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1022/2078] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:09 2022] DELETE /identity/v3/users/5fd1bd3a55de406d9f4b2adf35bef024 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:09.556135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0aa713-8c51-4fb6-82be-f3f9e0effa93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:09.557783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0aa713-8c51-4fb6-82be-f3f9e0effa93 service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:09.577965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1057/2079] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:09.811535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:09.813141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:09.893856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89f6c-e4ee-440f-b56c-379f21f6ab7a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:09.898566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:09.899450 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:09.899727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:09.900019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] PATH_INFO: `/v3/projects/0d340df02c724bee810b3f8874379cfc` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:09.901264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d340df02c724bee810b3f8874379cfc)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:09.905166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:09.939037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:09.956980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d340df02c724bee810b3f8874379cfc', 'request_id': 'req-1cd7eff4-8816-4117-8fee-76f92c895361'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.965050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d340df02c724bee810b3f8874379cfc', 'request_id': 'req-1cd7eff4-8816-4117-8fee-76f92c895361'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.972108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d340df02c724bee810b3f8874379cfc', 'request_id': 'req-1cd7eff4-8816-4117-8fee-76f92c895361'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.983854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] The token cache is being invalidate because project 0d340df02c724bee810b3f8874379cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:09.984174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.984829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1cd7eff4-8816-4117-8fee-76f92c895361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:09.986602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1023/2080] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:09 2022] DELETE /identity/v3/projects/0d340df02c724bee810b3f8874379cfc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:09.992047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:09.992337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:09.992619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.015084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:10.016368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:10.085166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1058/2081] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:10.093663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.093955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.094233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.113873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:10.115100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:10.125629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1024/2082] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:10.130082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.141912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1570-e5f1-44b3-b6e3-cadf808acaf2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.146737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.147406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.147686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.147959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.148722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:10.149029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.150695 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.154528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:10.165440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1059/2083] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:10.171132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.182507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79b18e-eaf0-4498-8276-c0aa2620c518 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.188801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.189519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.189803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.190077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.190800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.192726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.223300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1025/2084] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:10 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:10.227802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.239880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ac8cb-04ff-49bb-a4cf-b2354456bb69 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.310470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.311294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.311663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.312026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.312845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.315211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.338936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1060/2085] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:10 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:10.345497 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.358677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea9793-0fcd-496a-9f64-fac1473ec18d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.363690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.364355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.364630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.365078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.365862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.367507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.379625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1026/2086] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:10.383835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.396421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86456eb-f4f2-4681-8ca4-72ceb1759816 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.401431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801207b-2477-4c7f-ae59-8c883707a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.402127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801207b-2477-4c7f-ae59-8c883707a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.402402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801207b-2477-4c7f-ae59-8c883707a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.402679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801207b-2477-4c7f-ae59-8c883707a6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.403847 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801207b-2477-4c7f-ae59-8c883707a6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.405554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801207b-2477-4c7f-ae59-8c883707a6b6 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.419264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1061/2087] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:10.423512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.434455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a163-a764-436c-9d82-81b4fc066cc7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.440188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.441100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.441430 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.441711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] PATH_INFO: `/v3/projects/1593797d34a04b169379da1a51e18072/users/97aa07a49016448d9b1067ce0dbd8d99/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.461520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1593797d34a04b169379da1a51e18072, user_id=97aa07a49016448d9b1067ce0dbd8d99, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.464344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.479297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1027/2088] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:10 2022] PUT /identity/v3/projects/1593797d34a04b169379da1a51e18072/users/97aa07a49016448d9b1067ce0dbd8d99/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:10.487992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796da7-fe71-40c3-b1e4-c51f81f10f04 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.488296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796da7-fe71-40c3-b1e4-c51f81f10f04 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.488549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796da7-fe71-40c3-b1e4-c51f81f10f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.507321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a6796da7-fe71-40c3-b1e4-c51f81f10f04 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:10.508552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a6796da7-fe71-40c3-b1e4-c51f81f10f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:10.582799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1062/2089] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:10.593086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:10.594937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:10.666818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef332e-a78e-4ce3-84d1-8e9946920ec8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:10.671050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c1e74-2aee-42d2-8014-2c240d6d2359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:10.671720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1e74-2aee-42d2-8014-2c240d6d2359 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:10.672036 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1e74-2aee-42d2-8014-2c240d6d2359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:10.672314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1e74-2aee-42d2-8014-2c240d6d2359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:10.681945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1e74-2aee-42d2-8014-2c240d6d2359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:10.683392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c1e74-2aee-42d2-8014-2c240d6d2359 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:10.694549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1028/2090] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:11.914464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:11.915008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:11.915008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:11.936289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] MFA Rules not processed for user `3955b4cf3ef54207b09d7008906221e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:11.936289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:12.030729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1063/2091] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:17.066842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3d99-eadb-44c1-8cb3-97827580205c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:17.067309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3d99-eadb-44c1-8cb3-97827580205c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:17.067400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb3d99-eadb-44c1-8cb3-97827580205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:17.101303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-32eb3d99-eadb-44c1-8cb3-97827580205c None None] MFA Rules not processed for user `97aa07a49016448d9b1067ce0dbd8d99`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:17.102658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-32eb3d99-eadb-44c1-8cb3-97827580205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:17.156997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:17.188849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1029/2092] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:17.206929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:17.208505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:17.257011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:17.337184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351069a2-ec1a-4d38-a537-d3919d212ffa None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:17.344622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:17.345242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:17.345554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:17.345823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:17.356898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:17.357783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:17.370566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1064/2093] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:19.578261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00fdc-eb0d-4903-8ae5-77484f8475c2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:19.579382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00fdc-eb0d-4903-8ae5-77484f8475c2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:19.579861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba00fdc-eb0d-4903-8ae5-77484f8475c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:19.603862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0ba00fdc-eb0d-4903-8ae5-77484f8475c2 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:19.605901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0ba00fdc-eb0d-4903-8ae5-77484f8475c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:19.707420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1030/2094] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:19.753074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:19.754663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:19.855194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb6cc-4103-43f6-a8c3-24ab6e8e3366 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:19.862289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f06e9d-2d1b-43ab-bbcf-d0ab967e43e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:19.863330 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06e9d-2d1b-43ab-bbcf-d0ab967e43e8 service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:19.863617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06e9d-2d1b-43ab-bbcf-d0ab967e43e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:19.864061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06e9d-2d1b-43ab-bbcf-d0ab967e43e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:19.876254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06e9d-2d1b-43ab-bbcf-d0ab967e43e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:19.878122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06e9d-2d1b-43ab-bbcf-d0ab967e43e8 service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:19.889442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1065/2095] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:17:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:19.990685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:19.991058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:19.991394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:20.014771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] MFA Rules not processed for user `97aa07a49016448d9b1067ce0dbd8d99`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:20.016389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:20.035131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1031/2096] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:20.816062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca41cee-4113-49b1-9021-4fc916f5e4e3 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:20.816972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca41cee-4113-49b1-9021-4fc916f5e4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:20.817254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca41cee-4113-49b1-9021-4fc916f5e4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:20.842712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6ca41cee-4113-49b1-9021-4fc916f5e4e3 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:20.843960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6ca41cee-4113-49b1-9021-4fc916f5e4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:20.858101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1066/2097] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 15 22:17:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:20.872508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:20.903543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e70d26-9ac5-4548-a848-7e435102b4c5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:20.915546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:20.916234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:20.916511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:20.916780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:20.948151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:20.949954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:20.972570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1032/2098] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:17:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:21.426047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadc9d-ee1f-43f7-b205-20c40507283e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:21.426328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadc9d-ee1f-43f7-b205-20c40507283e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:21.426614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadc9d-ee1f-43f7-b205-20c40507283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:21.451575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-adfadc9d-ee1f-43f7-b205-20c40507283e None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:21.459844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-adfadc9d-ee1f-43f7-b205-20c40507283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:21.469708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1067/2099] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:21.483804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:21.495388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff85a8-5a10-4e54-b6f6-e1b437282bd5 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:21.520226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:21.525841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:21.526129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:21.526602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:21.546644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:21.556268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:21.568384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1033/2100] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:17:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:22.306068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:22.307370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:22.307903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:22.338232 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:22.340968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:22.353905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1068/2101] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 15 22:17:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:22.367603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:22.379757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ce745-b5a6-4f6b-951c-1ad9e347d55f service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:22.385367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444f0a9-1bb1-4f0f-bf79-e6e254195eb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:22.385959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f0a9-1bb1-4f0f-bf79-e6e254195eb0 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:22.386241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f0a9-1bb1-4f0f-bf79-e6e254195eb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:22.386548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444f0a9-1bb1-4f0f-bf79-e6e254195eb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:22.395746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444f0a9-1bb1-4f0f-bf79-e6e254195eb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:22.397408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444f0a9-1bb1-4f0f-bf79-e6e254195eb0 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:22.406278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1034/2102] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:17:23.685607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:23.687642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:23.736635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480933c-d82c-4c6c-bc8c-4fb10be208e3 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:23.748194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:23.749276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:23.749651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:23.749935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] PATH_INFO: `/v3/users/dc90fa5675084e6f899834aba28e488c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:23.752082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc90fa5675084e6f899834aba28e488c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:23.754298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:23.851715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc90fa5675084e6f899834aba28e488c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:23.877375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc90fa5675084e6f899834aba28e488c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:23.879584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc90fa5675084e6f899834aba28e488c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:23.895903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:23.897573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc90fa5675084e6f899834aba28e488c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:23.913860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc90fa5675084e6f899834aba28e488c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:23.926970 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1069/2103] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:23 2022] DELETE /identity/v3/users/dc90fa5675084e6f899834aba28e488c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:23.933019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:23.933489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:23.933827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:23.962340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:23.963605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:24.071391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1035/2104] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:24.083509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:24.086328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:24.237420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf782ba-0924-4f6a-ab35-49547fe76f19 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:24.244116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c54ce0-90df-4699-b6f7-dd28eff9f7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:24.245043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c54ce0-90df-4699-b6f7-dd28eff9f7aa service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:24.245377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c54ce0-90df-4699-b6f7-dd28eff9f7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:24.245681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c54ce0-90df-4699-b6f7-dd28eff9f7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:24.256995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c54ce0-90df-4699-b6f7-dd28eff9f7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:24.259647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c54ce0-90df-4699-b6f7-dd28eff9f7aa service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:24.274870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1070/2105] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:24.745157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:24.746703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:24.767091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1c4c-86ba-4b58-bfbc-71df298f671c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:24.781903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:24.782805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:24.783087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:24.783371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] PATH_INFO: `/v3/projects/29e579caa3004d389a6dc075dabdc05a` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:24.784682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e579caa3004d389a6dc075dabdc05a)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:24.786605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:24.875852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:24.898882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e579caa3004d389a6dc075dabdc05a', 'request_id': 'req-d055598f-6cd5-482b-8b4c-689db5502d7e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:24.917707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e579caa3004d389a6dc075dabdc05a', 'request_id': 'req-d055598f-6cd5-482b-8b4c-689db5502d7e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:24.935573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e579caa3004d389a6dc075dabdc05a', 'request_id': 'req-d055598f-6cd5-482b-8b4c-689db5502d7e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:24.949206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] The token cache is being invalidate because project 29e579caa3004d389a6dc075dabdc05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:24.949655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:24.950549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:24.955463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1036/2106] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:24 2022] DELETE /identity/v3/projects/29e579caa3004d389a6dc075dabdc05a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:24.957222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363ce37-c290-4dac-b7d4-0a4ff6294437 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:24.958044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363ce37-c290-4dac-b7d4-0a4ff6294437 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:24.958533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363ce37-c290-4dac-b7d4-0a4ff6294437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:24.990921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7363ce37-c290-4dac-b7d4-0a4ff6294437 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:24.992189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7363ce37-c290-4dac-b7d4-0a4ff6294437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.082482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.084157 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.085833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1071/2107] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:25.093479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.097547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.097832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.103049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055598f-6cd5-482b-8b4c-689db5502d7e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.109648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.110586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.110869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.111143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] PATH_INFO: `/v3/users/4ed4f9b918ed45c8a7f8d135b4a84e41` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.113931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed4f9b918ed45c8a7f8d135b4a84e41)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.116241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.119722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:25.120943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.132708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1072/2108] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:25.137958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.148471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62614-c8f2-432f-9d09-e919f5c30d66 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.157748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.158760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.159192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.159671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.160644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:25.161155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.163075 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.182203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1073/2109] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:17:25.183098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.189559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.198412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed4f9b918ed45c8a7f8d135b4a84e41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.207702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5181c-e67b-4ecd-b05a-257f2293b673 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.212052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed4f9b918ed45c8a7f8d135b4a84e41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.213025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.214050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.214411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.214781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] PATH_INFO: `/v3/users/9a20070eef754e669bcdbcc83fd44a5c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.217023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a20070eef754e669bcdbcc83fd44a5c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.219271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.224445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed4f9b918ed45c8a7f8d135b4a84e41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.225192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed4f9b918ed45c8a7f8d135b4a84e41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.242204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed4f9b918ed45c8a7f8d135b4a84e41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.254327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1037/2110] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:25 2022] DELETE /identity/v3/users/4ed4f9b918ed45c8a7f8d135b4a84e41 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:25.254327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.254327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.319969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a20070eef754e669bcdbcc83fd44a5c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.331411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a20070eef754e669bcdbcc83fd44a5c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.332292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a20070eef754e669bcdbcc83fd44a5c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.343444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:25.344870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e375-1d21-4e98-810e-3e5f440cfa44 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.350266 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a20070eef754e669bcdbcc83fd44a5c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.351588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660170f1-b816-4d58-adef-98dec3615985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.352643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660170f1-b816-4d58-adef-98dec3615985 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.353232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660170f1-b816-4d58-adef-98dec3615985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.353602 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660170f1-b816-4d58-adef-98dec3615985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.354531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660170f1-b816-4d58-adef-98dec3615985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.357949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660170f1-b816-4d58-adef-98dec3615985 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.361675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2b1edbb6-6c41-4d34-820c-305c69dd9315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a20070eef754e669bcdbcc83fd44a5c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:25.372355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1074/2111] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:25 2022] DELETE /identity/v3/users/9a20070eef754e669bcdbcc83fd44a5c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:25.372355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.372651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.372738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.397730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1038/2112] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:25 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:25.397950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:25.397950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.398110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.398110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.398110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.422161 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:25.423605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.448393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:25.481277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1075/2113] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:25.482288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.483688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.497070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae345-0faf-4807-9fdd-2c4efb46017d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.502624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.503505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.503793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.504439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.504779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.506788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.531141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1076/2114] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:25 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:25.532397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.535017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.539311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1039/2115] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:25.539311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.554846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56d94-a3e3-4196-acd8-c81d44d1fd14 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.561464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.562162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.562474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.562778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.563597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.565251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.576773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1040/2116] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:25.577466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.579508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.614482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed28ee-c585-4ea5-814b-46a614e072de admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.618766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.619511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.619791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.620118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.631480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.634185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.646353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1077/2117] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:25.647138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.657644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8bcd-7235-4ecf-abac-fa3cb9c88d0c service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.662796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.663477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b97040-096b-45fd-8a4f-f54b7f572416 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.663617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.663806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.664032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.664772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.666432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.668964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d586980-4ad1-402a-8357-bb49022e8f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.671901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d586980-4ad1-402a-8357-bb49022e8f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.672193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d586980-4ad1-402a-8357-bb49022e8f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.672634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d586980-4ad1-402a-8357-bb49022e8f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.684835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1078/2118] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:25.686192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d586980-4ad1-402a-8357-bb49022e8f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.686317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.687856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d586980-4ad1-402a-8357-bb49022e8f6d service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.698928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b785aa5-4a6b-4857-a629-bdf4aebebf1b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.700294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1041/2119] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:25.707929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.708995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.709262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.711074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] PATH_INFO: `/v3/projects/1c2773d61c84492fb70a7a59cffa6fdb/users/c603735d259e4ea390006779d4e76575/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.734889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2773d61c84492fb70a7a59cffa6fdb, user_id=c603735d259e4ea390006779d4e76575, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:25.738097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:25.759820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1079/2120] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:25 2022] PUT /identity/v3/projects/1c2773d61c84492fb70a7a59cffa6fdb/users/c603735d259e4ea390006779d4e76575/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:25.767745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.767745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.767745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:25.786848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:25.788104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:25.880263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1042/2121] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:25.904157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:25.951824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:25.987421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b5e88-89d2-45eb-81af-1d661a8d7d52 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:25.992484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:25.993396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:25.993752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:25.994096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:26.007384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:26.008455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:26.022795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1080/2122] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:26.534935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:26.537706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:26.580220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abbeb3-ff71-4ac9-970d-6a4f0ccbf569 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:26.589221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:26.591718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:26.592175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:26.592889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] PATH_INFO: `/v3/projects/4b9143eb19784ee68d32ba580bc47797` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:26.595171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9143eb19784ee68d32ba580bc47797)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:26.599140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:26.641306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:26.644190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:26.684917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d206491-77f9-4cad-9bd1-942333163724 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:26.702184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9143eb19784ee68d32ba580bc47797', 'request_id': 'req-7ddd149f-a67b-4d72-94ed-784d998dd704'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.705381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:26.719772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9143eb19784ee68d32ba580bc47797', 'request_id': 'req-7ddd149f-a67b-4d72-94ed-784d998dd704'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.765946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9143eb19784ee68d32ba580bc47797', 'request_id': 'req-7ddd149f-a67b-4d72-94ed-784d998dd704'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.807632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] The token cache is being invalidate because project 4b9143eb19784ee68d32ba580bc47797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:26.807925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.832828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.836543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:26.838150 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:26.838636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:26.839104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] PATH_INFO: `/v3/projects/9c69fde155f34fd5a48e916b85a87bf2` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:26.841937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c69fde155f34fd5a48e916b85a87bf2)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:26.845918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:26.847679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1043/2123] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:26 2022] DELETE /identity/v3/projects/4b9143eb19784ee68d32ba580bc47797 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:26.948285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c69fde155f34fd5a48e916b85a87bf2', 'request_id': 'req-823e4070-108f-47eb-b0ff-314511b4dd67'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.960510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c69fde155f34fd5a48e916b85a87bf2', 'request_id': 'req-823e4070-108f-47eb-b0ff-314511b4dd67'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:26.975898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c69fde155f34fd5a48e916b85a87bf2', 'request_id': 'req-823e4070-108f-47eb-b0ff-314511b4dd67'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.008347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] The token cache is being invalidate because project 9c69fde155f34fd5a48e916b85a87bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:27.009056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.010255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-823e4070-108f-47eb-b0ff-314511b4dd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.019890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:27.020348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1081/2124] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:26 2022] DELETE /identity/v3/projects/9c69fde155f34fd5a48e916b85a87bf2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:27.022679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:27.055604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd149f-a67b-4d72-94ed-784d998dd704 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:27.251747 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:27.252347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:27.252641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:27.252931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] PATH_INFO: `/v3/users/5ddc8df9e59e4b078167ace69f84ef5c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:27.254515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddc8df9e59e4b078167ace69f84ef5c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:27.256572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:27.344215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddc8df9e59e4b078167ace69f84ef5c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.358549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddc8df9e59e4b078167ace69f84ef5c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.373991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddc8df9e59e4b078167ace69f84ef5c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.374695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddc8df9e59e4b078167ace69f84ef5c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.394748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddc8df9e59e4b078167ace69f84ef5c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:27.402817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1044/2125] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:27 2022] DELETE /identity/v3/users/5ddc8df9e59e4b078167ace69f84ef5c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:27.701492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411862-91e2-4cab-8339-f794544f57de None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:27.701791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411862-91e2-4cab-8339-f794544f57de None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:27.702072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411862-91e2-4cab-8339-f794544f57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:27.756717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-40411862-91e2-4cab-8339-f794544f57de None None] MFA Rules not processed for user `c603735d259e4ea390006779d4e76575`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:27.758123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-40411862-91e2-4cab-8339-f794544f57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:27.912920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:27.941529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1082/2126] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:27.951392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:27.953378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:28.036748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15b958-e4d8-40ac-bc00-d2a7e4ad1a2d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.036748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4daad-dec1-4b5f-aad1-18926c0d386d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.036748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4daad-dec1-4b5f-aad1-18926c0d386d service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.036748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4daad-dec1-4b5f-aad1-18926c0d386d service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.037256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4daad-dec1-4b5f-aad1-18926c0d386d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.046362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4daad-dec1-4b5f-aad1-18926c0d386d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.047822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4daad-dec1-4b5f-aad1-18926c0d386d service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.053457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:28.059245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1045/2127] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:17:28.107327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411862-91e2-4cab-8339-f794544f57de None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.108846 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-40411862-91e2-4cab-8339-f794544f57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:28.201505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411862-91e2-4cab-8339-f794544f57de None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.207014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.207919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.208197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.208469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] PATH_INFO: `/v3/projects/1ff7e768960d4cdeb223baa24da9c8ef` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.209826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff7e768960d4cdeb223baa24da9c8ef)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.211804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.288976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff7e768960d4cdeb223baa24da9c8ef', 'request_id': 'req-0029fa2b-4105-4f33-8df9-9c4c85585f9b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:28.295784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff7e768960d4cdeb223baa24da9c8ef', 'request_id': 'req-0029fa2b-4105-4f33-8df9-9c4c85585f9b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:28.302778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff7e768960d4cdeb223baa24da9c8ef', 'request_id': 'req-0029fa2b-4105-4f33-8df9-9c4c85585f9b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:28.320812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] The token cache is being invalidate because project 1ff7e768960d4cdeb223baa24da9c8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:28.321208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:28.322012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0029fa2b-4105-4f33-8df9-9c4c85585f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:28.323980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1083/2128] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:28 2022] DELETE /identity/v3/projects/1ff7e768960d4cdeb223baa24da9c8ef => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:28.331536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.331920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.332611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.365144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:28.366539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:28.454503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1046/2129] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:28.463613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.464069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.464541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.486947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:28.488206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:28.497925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1084/2130] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:28.502597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.513882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9285ad-c196-43b2-a3e6-df07868626d9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.518977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.519649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.519940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.520211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.520940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:28.521236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.522901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.542000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1047/2131] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:17:28.543158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.555413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc71f6-036a-4fc4-ae57-553454fe4e65 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.563485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.564178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.564466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.564741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.565490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.567465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.596863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1085/2132] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:28 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:28.601696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.613236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b791-e700-4b9d-8765-d5ffbb4f17d7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.680374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.681360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.681744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.681993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.682710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.685034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.707434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1048/2133] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:28 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:28.711956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.724174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9fd83-a5be-4fc6-bd69-04245dfb95b3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.728978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.729705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.729991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.730254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.731149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.732888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.744419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1086/2134] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:28.748683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.762805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f91946-bda0-46a2-b0e7-9ab9ec4a022b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.768642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a3eff-54cd-40c3-8873-dc58884fae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.769598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3eff-54cd-40c3-8873-dc58884fae44 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.770025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3eff-54cd-40c3-8873-dc58884fae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.770365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3eff-54cd-40c3-8873-dc58884fae44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.771469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3eff-54cd-40c3-8873-dc58884fae44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.773844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3eff-54cd-40c3-8873-dc58884fae44 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.786829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1049/2135] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:28.792430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:28.811618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05284fe-8d9d-48a5-b337-817b867f3220 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:28.821031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:28.822696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.823176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.824151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] PATH_INFO: `/v3/projects/01680e3c5b754a8b9a69509f9425e265/users/7ed81516f61442328e37e314e04bdff8/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.847292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01680e3c5b754a8b9a69509f9425e265, user_id=7ed81516f61442328e37e314e04bdff8, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:28.850560 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:28.870008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1087/2136] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:28 2022] PUT /identity/v3/projects/01680e3c5b754a8b9a69509f9425e265/users/7ed81516f61442328e37e314e04bdff8/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:28.882182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:28.882477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:28.882754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:28.916472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] MFA Rules not processed for user `7ed81516f61442328e37e314e04bdff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:28.917931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:28.988523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:29.009546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1050/2137] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:29.010477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.054052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:29.118458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bead1f-7c22-42e2-a615-64c17bcab56c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.124215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.124933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.125296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.125610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.126363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.128694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.175225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1088/2138] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:29 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:29.180799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.197822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe41e77-e6b8-422d-89b6-4baa2c507d48 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.275399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.276124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.276364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.276636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.277349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.279925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.305974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1051/2139] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:29 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:29.307192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.318253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ee14e-49bb-4901-91aa-e5cce2e9ff1d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.323413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.324105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.324499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.324741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.325490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.327118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.340327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1089/2140] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:29.351125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.363038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190f832-5eb8-48ca-b1d4-480d4bffb1b3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.368233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d21494-6d9a-4557-80e3-9482985d619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.369200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21494-6d9a-4557-80e3-9482985d619d admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.369488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21494-6d9a-4557-80e3-9482985d619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.369767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21494-6d9a-4557-80e3-9482985d619d admin admin] PATH_INFO: `/v3/projects/c88c7c22b68c46d6989cae1d27724586/users/2cf4b6fc30e24524a692904a0e9452f8/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.385940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d21494-6d9a-4557-80e3-9482985d619d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88c7c22b68c46d6989cae1d27724586, user_id=2cf4b6fc30e24524a692904a0e9452f8, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.389175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d21494-6d9a-4557-80e3-9482985d619d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.404013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1052/2141] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:29 2022] PUT /identity/v3/projects/c88c7c22b68c46d6989cae1d27724586/users/2cf4b6fc30e24524a692904a0e9452f8/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:29.408598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.419869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3038db3-6219-4aa2-83e8-a2d891c0f355 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.499076 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.501083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.501552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.501968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.511604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.512486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.512687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.514668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.516603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.534004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1090/2142] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:29.534251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] MFA Rules not processed for user `c603735d259e4ea390006779d4e76575`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:29.534251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:29.535087 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.546708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df105d-b1a4-4ced-84bd-77c3d21c42b3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.553535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f68fc-3100-4ac9-a466-bf7349cbe8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.554453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f68fc-3100-4ac9-a466-bf7349cbe8d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.554731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f68fc-3100-4ac9-a466-bf7349cbe8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.555002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f68fc-3100-4ac9-a466-bf7349cbe8d0 admin admin] PATH_INFO: `/v3/projects/c88c7c22b68c46d6989cae1d27724586/users/2cf4b6fc30e24524a692904a0e9452f8/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.557625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f68fc-3100-4ac9-a466-bf7349cbe8d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88c7c22b68c46d6989cae1d27724586, user_id=2cf4b6fc30e24524a692904a0e9452f8, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.561355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f68fc-3100-4ac9-a466-bf7349cbe8d0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.582876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1091/2143] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:29 2022] PUT /identity/v3/projects/c88c7c22b68c46d6989cae1d27724586/users/2cf4b6fc30e24524a692904a0e9452f8/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:29.586789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.587955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.588180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.610649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1053/2144] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:29.640540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] MFA Rules not processed for user `2cf4b6fc30e24524a692904a0e9452f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:29.641807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:29.726396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1092/2145] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:29.738477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:29.740815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:29.824722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9f285-26c0-48b8-b663-e2c865a8db4e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:29.855893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:29.917687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671920b0-99d4-43b2-a975-75d7226ab923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:29.919554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671920b0-99d4-43b2-a975-75d7226ab923 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:29.919554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671920b0-99d4-43b2-a975-75d7226ab923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:29.919874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671920b0-99d4-43b2-a975-75d7226ab923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:29.937468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671920b0-99d4-43b2-a975-75d7226ab923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:29.939798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671920b0-99d4-43b2-a975-75d7226ab923 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:29.954952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1054/2146] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:32.038933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:32.048204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:32.127280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9181e9-fe7d-43d0-881e-d441710134df None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:32.132934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:32.133954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:32.134295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:32.134641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] PATH_INFO: `/v3/users/7ed81516f61442328e37e314e04bdff8` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:32.135961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed81516f61442328e37e314e04bdff8)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:32.138479 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:32.198786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed81516f61442328e37e314e04bdff8'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:32.207917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed81516f61442328e37e314e04bdff8'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:32.208624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed81516f61442328e37e314e04bdff8'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:32.224296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed81516f61442328e37e314e04bdff8'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:32.235418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed81516f61442328e37e314e04bdff8'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:32.243524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1093/2147] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:32 2022] DELETE /identity/v3/users/7ed81516f61442328e37e314e04bdff8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:32.248961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9740ac-5529-49d2-acab-de8f5447678b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:32.249594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9740ac-5529-49d2-acab-de8f5447678b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:32.249683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9740ac-5529-49d2-acab-de8f5447678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:32.269721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1a9740ac-5529-49d2-acab-de8f5447678b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:32.271066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1a9740ac-5529-49d2-acab-de8f5447678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:32.343056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1055/2148] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:32.355081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:32.356736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:32.464364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080de264-c0b4-4dd4-be11-c0084a2d0fc1 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:32.468471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:32.469162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:32.469485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:32.469765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:32.482806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:32.485122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:32.497257 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1094/2149] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:32.842016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:32.842281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:32.842604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:32.867773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] MFA Rules not processed for user `3955b4cf3ef54207b09d7008906221e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:32.869026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:32.935924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1056/2150] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:33.116423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:33.118025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:33.133977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5d23-66db-4bef-92b0-9a01477f383e service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:33.139148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:33.140604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:33.141149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:33.141527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] PATH_INFO: `/v3/projects/01680e3c5b754a8b9a69509f9425e265` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:33.143108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01680e3c5b754a8b9a69509f9425e265)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:33.145462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:33.186823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:33.240651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01680e3c5b754a8b9a69509f9425e265', 'request_id': 'req-b13d514f-c34a-47ef-b9c4-c148d9dd9517'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.251387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01680e3c5b754a8b9a69509f9425e265', 'request_id': 'req-b13d514f-c34a-47ef-b9c4-c148d9dd9517'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.259726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01680e3c5b754a8b9a69509f9425e265', 'request_id': 'req-b13d514f-c34a-47ef-b9c4-c148d9dd9517'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.279102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] The token cache is being invalidate because project 01680e3c5b754a8b9a69509f9425e265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:33.279703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.281094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.286189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1095/2151] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:33 2022] DELETE /identity/v3/projects/01680e3c5b754a8b9a69509f9425e265 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:33.287551 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:33.299803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0694c6-7343-47f4-955f-e2ad4c1d33cb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:33.368050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:33.368974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:33.369258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:33.369572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] PATH_INFO: `/v3/users/2cf4b6fc30e24524a692904a0e9452f8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:33.370905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf4b6fc30e24524a692904a0e9452f8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:33.373386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:33.389078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:33.433535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf4b6fc30e24524a692904a0e9452f8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.444969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf4b6fc30e24524a692904a0e9452f8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.455623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf4b6fc30e24524a692904a0e9452f8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.457079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf4b6fc30e24524a692904a0e9452f8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.477689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8d2a632d-fec6-41e3-a4bd-e86e2e728356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf4b6fc30e24524a692904a0e9452f8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:33.484811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1057/2152] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:33 2022] DELETE /identity/v3/users/2cf4b6fc30e24524a692904a0e9452f8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:33.957078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:33.958725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:33.991169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d514f-c34a-47ef-b9c4-c148d9dd9517 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.078816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.080130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.080130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.080572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] PATH_INFO: `/v3/projects/c88c7c22b68c46d6989cae1d27724586` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.083657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88c7c22b68c46d6989cae1d27724586)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.086994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.184139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88c7c22b68c46d6989cae1d27724586', 'request_id': 'req-8f33cf62-755a-4644-a311-481a8a7c5bef'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:34.194170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88c7c22b68c46d6989cae1d27724586', 'request_id': 'req-8f33cf62-755a-4644-a311-481a8a7c5bef'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:34.205659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88c7c22b68c46d6989cae1d27724586', 'request_id': 'req-8f33cf62-755a-4644-a311-481a8a7c5bef'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:34.228616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] The token cache is being invalidate because project c88c7c22b68c46d6989cae1d27724586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:34.229243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:34.236365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8f33cf62-755a-4644-a311-481a8a7c5bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:34.248129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1096/2153] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:33 2022] DELETE /identity/v3/projects/c88c7c22b68c46d6989cae1d27724586 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:34.249067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.249425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.249741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.303213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:34.304461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:34.455278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1058/2154] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:34.457187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.457684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.458113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.480779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:34.482316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:34.491942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1097/2155] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:34.496280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:34.506498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a685e58-7bd2-4b21-8c5e-e8fbee989b58 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.511428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.512519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.513046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.513414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.514292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:34.514607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.516265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.533770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1059/2156] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:34.535407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:34.545371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a820813-2a59-4d27-975a-1edf3e524c15 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.550276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.550956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.551236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.551508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.552217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.554183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.585400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1098/2157] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:34 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:34.588918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:34.600242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f1abf-8a90-45b3-a7de-b2d93e804f10 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.668434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.669308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.669630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.669907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.670620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.672581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.694682 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1060/2158] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:34 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:34.698906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:34.713046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890e6d6-1b0e-4c0b-a710-8601e2362610 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.722694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.724113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.724410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.724739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.725516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.727587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.736416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:34.748755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:34.749529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1099/2159] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:34.767516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ee9fa-eea8-4e6d-87ff-7d43eb093e02 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.773534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0ace-cd08-4fcd-9b76-b2e08724ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.774563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0ace-cd08-4fcd-9b76-b2e08724ec91 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.774847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0ace-cd08-4fcd-9b76-b2e08724ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.775122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0ace-cd08-4fcd-9b76-b2e08724ec91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.775867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0ace-cd08-4fcd-9b76-b2e08724ec91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.777879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0ace-cd08-4fcd-9b76-b2e08724ec91 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.779660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:34.797034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:34.797969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1061/2160] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:34.807707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd403dda-85a5-4664-ad5e-782e43734e3e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:34.815392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:34.816311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.816593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.816869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] PATH_INFO: `/v3/projects/ad3310d50c4d47a9b6935c0f17e17491/users/db034e259d9a48868429191554cfeb9d/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.836400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3310d50c4d47a9b6935c0f17e17491, user_id=db034e259d9a48868429191554cfeb9d, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:34.839517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:34.856168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1100/2161] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:34 2022] PUT /identity/v3/projects/ad3310d50c4d47a9b6935c0f17e17491/users/db034e259d9a48868429191554cfeb9d/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:34.871030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:34.871304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:34.873825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:34.912722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] MFA Rules not processed for user `db034e259d9a48868429191554cfeb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:34.915526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:34.996705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1062/2162] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:35.001654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.072484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fcb75-0c14-4fcc-a4f4-4af0abb3ad22 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.077712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.078384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.078664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.078938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.079649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.081613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.112650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1101/2163] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:35 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:35.116896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.128228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3f5a-62e3-4286-9fe6-b43adfda22c3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.199668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.200372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.200654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.200914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.201690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.203721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.226690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1063/2164] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:35 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:35.232170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.246072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47143ded-94ac-4936-a586-960bb709ed3e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.252373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.253051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.253365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.253749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.254383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.256134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.267735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1102/2165] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:35.271990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.282968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52fc3-00e4-4b8a-9a15-41700076932d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.290694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.291636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.291911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.292183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] PATH_INFO: `/v3/projects/54697c5bbb544c1991a6fd9cec6bdb99/users/d002972c35334a509a3a14e6530f474a/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.311287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54697c5bbb544c1991a6fd9cec6bdb99, user_id=d002972c35334a509a3a14e6530f474a, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.313988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.329415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1064/2166] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:35 2022] PUT /identity/v3/projects/54697c5bbb544c1991a6fd9cec6bdb99/users/d002972c35334a509a3a14e6530f474a/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:35.332614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.342677 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3e6ae-c97d-493f-a7d2-b95b874b9774 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.401117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72170a4-c5ea-40cf-a2b8-f346e33bfabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.401844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72170a4-c5ea-40cf-a2b8-f346e33bfabe admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.402110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72170a4-c5ea-40cf-a2b8-f346e33bfabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.402642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72170a4-c5ea-40cf-a2b8-f346e33bfabe admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.403496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72170a4-c5ea-40cf-a2b8-f346e33bfabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.405177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72170a4-c5ea-40cf-a2b8-f346e33bfabe admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.419531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1103/2167] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:35.420876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.431371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88b35-c3ec-4b14-b161-09de9c7bbbd0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.436745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.437765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.438165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.438449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] PATH_INFO: `/v3/projects/54697c5bbb544c1991a6fd9cec6bdb99/users/d002972c35334a509a3a14e6530f474a/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.440500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54697c5bbb544c1991a6fd9cec6bdb99, user_id=d002972c35334a509a3a14e6530f474a, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.443190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.455080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1065/2168] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:35 2022] PUT /identity/v3/projects/54697c5bbb544c1991a6fd9cec6bdb99/users/d002972c35334a509a3a14e6530f474a/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:35.466340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.466683 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.466972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.496493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] MFA Rules not processed for user `d002972c35334a509a3a14e6530f474a`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:35.497816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:35.533814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:35.579545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1104/2169] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:35.587936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:35.590957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:35.640543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:35.661830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d14af5-4004-414f-9e49-6e08b40e1b28 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:35.667506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:35.668349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:35.668699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:35.669275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:35.681737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:35.684050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:35.697704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1066/2170] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:36.055955 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:36.065950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a4915-96dc-4235-8ee0-f0768ac5ca11 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:36.071554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd002972c35334a509a3a14e6530f474a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54697c5bbb544c1991a6fd9cec6bdb99', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:36.072254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:36.072514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:36.072798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:36.073577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:36.073891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:36.075841 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:36.090259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1105/2171] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:36.098241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:36.110867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08a52c-d393-4c57-adb7-e07ba24aef69 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:36.116194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd002972c35334a509a3a14e6530f474a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54697c5bbb544c1991a6fd9cec6bdb99', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:36.116832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:36.117110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:36.117447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:36.118144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:36.120075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:36.151277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1067/2172] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:36 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:36.156826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:36.168665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8bfffe-cda6-42b5-a383-c5fd607ad839 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:36.228615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd002972c35334a509a3a14e6530f474a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54697c5bbb544c1991a6fd9cec6bdb99', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:36.229308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:36.229618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:36.229900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:36.230680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:36.230986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:36.232641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:36.245892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1106/2173] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:36.296928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:36.311911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2140-c6d0-44e4-8a0a-1e3a798279c0 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:36.317910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd002972c35334a509a3a14e6530f474a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54697c5bbb544c1991a6fd9cec6bdb99', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:36.318744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:36.319023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:36.319303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] PATH_INFO: `/v3/projects/db2d0bcee24e4e80856c59e7d4cc79a4` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:36.320640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorizing `identity:delete_project(project_id=db2d0bcee24e4e80856c59e7d4cc79a4)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:36.322681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:36.376252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2d0bcee24e4e80856c59e7d4cc79a4', 'request_id': 'req-6487043d-5d02-40f4-9d03-3c6baabeec76'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.385936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2d0bcee24e4e80856c59e7d4cc79a4', 'request_id': 'req-6487043d-5d02-40f4-9d03-3c6baabeec76'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.395167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2d0bcee24e4e80856c59e7d4cc79a4', 'request_id': 'req-6487043d-5d02-40f4-9d03-3c6baabeec76'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.407975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] The token cache is being invalidate because project db2d0bcee24e4e80856c59e7d4cc79a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:36.408261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.409020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6487043d-5d02-40f4-9d03-3c6baabeec76 tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.410755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1068/2174] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:36 2022] DELETE /identity/v3/projects/db2d0bcee24e4e80856c59e7d4cc79a4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:36.665425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:36.667951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:36.821054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72dc0f-f327-4589-b6b5-7ca8297c46aa tempest-VolumeQuotaClassesTest-1710831956 tempest-VolumeQuotaClassesTest-1710831956-project-admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:36.902283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:36.903920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:36.904948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:36.905470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] PATH_INFO: `/v3/users/db034e259d9a48868429191554cfeb9d` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:36.908036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db034e259d9a48868429191554cfeb9d)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:36.911659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:36.914676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:36.981500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db034e259d9a48868429191554cfeb9d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.992733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db034e259d9a48868429191554cfeb9d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:36.994111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db034e259d9a48868429191554cfeb9d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.020247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db034e259d9a48868429191554cfeb9d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.029990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db034e259d9a48868429191554cfeb9d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.036118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1107/2175] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:36 2022] DELETE /identity/v3/users/db034e259d9a48868429191554cfeb9d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:37.041088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:37.041484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:37.041752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:37.071000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:37.072409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:37.164924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1069/2176] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:37.177196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:37.179902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:37.270457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d446b-7eb5-4a85-968f-564bc5cb9e96 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:37.276805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:37.277665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:37.277974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:37.278258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:37.289443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:37.290959 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:37.302367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1108/2177] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:37.636883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:37.642746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:37.669155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba60fad-0f5b-4005-b5dc-afc004b46331 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:37.677050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:37.682605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:37.683258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:37.683728 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] PATH_INFO: `/v3/projects/ad3310d50c4d47a9b6935c0f17e17491` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:37.685189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3310d50c4d47a9b6935c0f17e17491)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:37.687215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:37.751328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:37.767089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3310d50c4d47a9b6935c0f17e17491', 'request_id': 'req-5cac2492-95c9-4914-a3f4-090622851ffe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.777402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3310d50c4d47a9b6935c0f17e17491', 'request_id': 'req-5cac2492-95c9-4914-a3f4-090622851ffe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.787447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3310d50c4d47a9b6935c0f17e17491', 'request_id': 'req-5cac2492-95c9-4914-a3f4-090622851ffe'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.804992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] The token cache is being invalidate because project ad3310d50c4d47a9b6935c0f17e17491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:37.805388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.806166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:37.812010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1070/2178] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:37 2022] DELETE /identity/v3/projects/ad3310d50c4d47a9b6935c0f17e17491 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:37.812809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:37.826410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675664bf-7a51-4660-ba2e-c93958a78628 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:37.938729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:37.939645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:37.939965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:37.940779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] PATH_INFO: `/v3/users/d002972c35334a509a3a14e6530f474a` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:37.941719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d002972c35334a509a3a14e6530f474a)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:37.944112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:37.973295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:38.007504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd002972c35334a509a3a14e6530f474a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:38.016368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd002972c35334a509a3a14e6530f474a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:38.017015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd002972c35334a509a3a14e6530f474a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:38.036971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd002972c35334a509a3a14e6530f474a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:38.049199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c813b7ce-c045-48d4-8728-24bb501a86de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd002972c35334a509a3a14e6530f474a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:38.061252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1109/2179] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:37 2022] DELETE /identity/v3/users/d002972c35334a509a3a14e6530f474a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:38.904668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:38.907370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:38.921518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac2492-95c9-4914-a3f4-090622851ffe admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.030253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.031657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.031928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.032414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] PATH_INFO: `/v3/projects/54697c5bbb544c1991a6fd9cec6bdb99` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.033777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54697c5bbb544c1991a6fd9cec6bdb99)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.035927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.099388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54697c5bbb544c1991a6fd9cec6bdb99', 'request_id': 'req-66e6484b-c110-4a92-8fca-55e247d0baf9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:39.113352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54697c5bbb544c1991a6fd9cec6bdb99', 'request_id': 'req-66e6484b-c110-4a92-8fca-55e247d0baf9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:39.126516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54697c5bbb544c1991a6fd9cec6bdb99', 'request_id': 'req-66e6484b-c110-4a92-8fca-55e247d0baf9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:39.140413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] The token cache is being invalidate because project 54697c5bbb544c1991a6fd9cec6bdb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:39.140871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:39.141699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-66e6484b-c110-4a92-8fca-55e247d0baf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:39.143609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1071/2180] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:38 2022] DELETE /identity/v3/projects/54697c5bbb544c1991a6fd9cec6bdb99 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:39.148706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.149527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.149527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.169353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:39.170665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:39.259013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1110/2181] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:39.268159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.268159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.268159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.290346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:39.291605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:39.303149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1072/2182] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:39.311537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:39.328028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ca0a5-6a1e-4e90-8dd3-06470d141cd5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.334123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.334789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.335085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.335367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.336132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:39.336448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.338303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.357314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1111/2183] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:39.362057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:39.371864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92c290-552c-4410-b379-d352b4b4aea8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.379269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.380206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.380705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.381893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.382719 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.384831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.417495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1073/2184] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:39 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:39.421747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:39.435422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e489a7-64da-4733-9729-9e10f4bcf4a9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.517755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.518468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.518825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.519171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.520025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.522244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.557722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1112/2185] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:39 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:39.558672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:39.570716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49ff73-765d-4a8b-9c47-7a735268a892 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.582245 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.582979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.583269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.583546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.584328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.586010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.600634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1074/2186] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:39.604687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:39.620121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d9d3-51e6-4723-88e6-71b28ca9afe9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.631265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6e4a7-59da-4359-82f6-25290856ab21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.631988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e4a7-59da-4359-82f6-25290856ab21 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.632275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e4a7-59da-4359-82f6-25290856ab21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.632550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6e4a7-59da-4359-82f6-25290856ab21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.633299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6e4a7-59da-4359-82f6-25290856ab21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.634985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6e4a7-59da-4359-82f6-25290856ab21 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.650529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1113/2187] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:39.654560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:39.672069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac440d-e564-49cf-aaaf-b1fffeac8983 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:39.688720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:39.691554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.691983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.692395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] PATH_INFO: `/v3/projects/9de92dac9e0b48d3960f497538d2d588/users/63a8eedf1a044dfa8a55d4e1e1fa7616/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.714703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:39.722419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de92dac9e0b48d3960f497538d2d588, user_id=63a8eedf1a044dfa8a55d4e1e1fa7616, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:39.727892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:39.749448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1075/2188] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:39 2022] PUT /identity/v3/projects/9de92dac9e0b48d3960f497538d2d588/users/63a8eedf1a044dfa8a55d4e1e1fa7616/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:39.762329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:39.763332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:39.763615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:39.785153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:39.807488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] MFA Rules not processed for user `63a8eedf1a044dfa8a55d4e1e1fa7616`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:39.809030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:39.933590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1114/2189] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:39.934212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.083292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442187a1-182a-4328-8a5d-d79df7db3203 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.100546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.101914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.102585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.103388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.104968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.109783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.187550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1076/2190] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:39 2022] POST /identity/v3/projects => generated 397 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:40.191887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.203618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6ecfe-5a82-408c-8fd8-66b78ccc83a2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.327367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.328424 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.328893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.330356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.330356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.332475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.370681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1115/2191] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:40 2022] POST /identity/v3/users => generated 305 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:40.375266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.389270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15712515-17ef-45b9-9ba6-7d7f9592a2ab admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.393927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.394952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.394952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.395271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.396729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.397673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.415492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1077/2192] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:40.421234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.433631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fb96-bd3c-443b-8333-d5e5b584e539 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.438978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.439897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.440197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.440507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] PATH_INFO: `/v3/projects/8b41cb653e644cd3bb09399f3ccc3e4b/users/d636d7ea9777449e96bfc072452dd855/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.458151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b41cb653e644cd3bb09399f3ccc3e4b, user_id=d636d7ea9777449e96bfc072452dd855, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.460897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.477612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1116/2193] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:40 2022] PUT /identity/v3/projects/8b41cb653e644cd3bb09399f3ccc3e4b/users/d636d7ea9777449e96bfc072452dd855/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:40.481935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.492546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44389b-d989-4e29-8bda-68eeb6789366 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.566983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c27c-6a04-436f-97b5-c054f575b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.567615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c27c-6a04-436f-97b5-c054f575b974 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.567904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c27c-6a04-436f-97b5-c054f575b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.568182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c27c-6a04-436f-97b5-c054f575b974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.568947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c27c-6a04-436f-97b5-c054f575b974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.570694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c27c-6a04-436f-97b5-c054f575b974 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.588043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1078/2194] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:17:40.594339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.605611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef4d70-4868-4c06-bb85-48d6821a3d92 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.611231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.612161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.612443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.612714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] PATH_INFO: `/v3/projects/8b41cb653e644cd3bb09399f3ccc3e4b/users/d636d7ea9777449e96bfc072452dd855/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.615478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b41cb653e644cd3bb09399f3ccc3e4b, user_id=d636d7ea9777449e96bfc072452dd855, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.618222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.629832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1117/2195] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:40 2022] PUT /identity/v3/projects/8b41cb653e644cd3bb09399f3ccc3e4b/users/d636d7ea9777449e96bfc072452dd855/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:40.640439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.640732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.641016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.672965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] MFA Rules not processed for user `d636d7ea9777449e96bfc072452dd855`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:40.674253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:40.730758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:40.764120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1079/2196] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:40.775665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:40.777835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:40.867429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:40.876017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70626f9-b6df-4e51-b37c-886fe58dbc57 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:40.880892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:40.882056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:40.883411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:40.883591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:40.896673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:40.898480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:40.916175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1118/2197] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:41.037202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:41.057109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df8929-98c7-4502-bedc-0512bdd9c81e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:41.090377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11f7bc-8d28-4c59-8305-4a31016ed6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:41.091799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11f7bc-8d28-4c59-8305-4a31016ed6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:41.092173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11f7bc-8d28-4c59-8305-4a31016ed6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:41.092522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11f7bc-8d28-4c59-8305-4a31016ed6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:41.165073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11f7bc-8d28-4c59-8305-4a31016ed6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:41.166967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11f7bc-8d28-4c59-8305-4a31016ed6a0 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:41.178843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1080/2198] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:45.729687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:45.822688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4793-cefa-45fa-b348-53152e7db384 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:45.832346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:45.833297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:45.833625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:45.833901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] PATH_INFO: `/v3/users/63a8eedf1a044dfa8a55d4e1e1fa7616` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:45.835615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a8eedf1a044dfa8a55d4e1e1fa7616)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:45.838742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:45.954781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a8eedf1a044dfa8a55d4e1e1fa7616'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:45.983879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a8eedf1a044dfa8a55d4e1e1fa7616'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:45.984909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a8eedf1a044dfa8a55d4e1e1fa7616'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:46.004324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a8eedf1a044dfa8a55d4e1e1fa7616'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:46.015851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a8eedf1a044dfa8a55d4e1e1fa7616'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:46.028032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1119/2199] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:45 2022] DELETE /identity/v3/users/63a8eedf1a044dfa8a55d4e1e1fa7616 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:46.036780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:46.037805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:46.037805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:46.067977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:46.069613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:46.160308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1081/2200] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:46.175247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:46.177561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:46.254797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971762d-3770-40c0-9065-84789e16e909 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:46.259384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:46.260062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:46.260346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:46.260625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:46.272175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:46.274101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:46.285985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1120/2201] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:17:46.869019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:46.871518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:46.894264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b085ed8-b7b0-43e9-8704-aa5684ac816a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:46.900544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:46.901593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:46.901876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:46.902606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] PATH_INFO: `/v3/projects/9de92dac9e0b48d3960f497538d2d588` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:46.904603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de92dac9e0b48d3960f497538d2d588)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:46.906987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:46.992674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de92dac9e0b48d3960f497538d2d588', 'request_id': 'req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.007232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de92dac9e0b48d3960f497538d2d588', 'request_id': 'req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.016923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de92dac9e0b48d3960f497538d2d588', 'request_id': 'req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.034226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] The token cache is being invalidate because project 9de92dac9e0b48d3960f497538d2d588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:47.034939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.035789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.038053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1082/2202] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:46 2022] DELETE /identity/v3/projects/9de92dac9e0b48d3960f497538d2d588 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:47.045048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:47.056468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53116d1c-e8d5-4b9a-a597-2d87b5c87c94 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:47.073494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:47.187821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:47.188894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:47.189208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:47.189558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] PATH_INFO: `/v3/users/d636d7ea9777449e96bfc072452dd855` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:47.191157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d636d7ea9777449e96bfc072452dd855)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:47.193496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:47.283222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd636d7ea9777449e96bfc072452dd855'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.294156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd636d7ea9777449e96bfc072452dd855'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.295000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd636d7ea9777449e96bfc072452dd855'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.315063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd636d7ea9777449e96bfc072452dd855'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.331635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d354105d-d9c8-4977-889e-9f2486f7aeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd636d7ea9777449e96bfc072452dd855'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:47.342229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1121/2203] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:47 2022] DELETE /identity/v3/users/d636d7ea9777449e96bfc072452dd855 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:47.904422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:47.907515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:47.941926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d90967-8cbf-4fb4-9639-e6882e03f0f6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:47.952752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:48.089832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.091686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.092270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.092898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] PATH_INFO: `/v3/projects/8b41cb653e644cd3bb09399f3ccc3e4b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.095415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b41cb653e644cd3bb09399f3ccc3e4b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.100876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.188639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b41cb653e644cd3bb09399f3ccc3e4b', 'request_id': 'req-6af5a4d7-6465-4916-8bf3-6b04e937d75a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:48.199732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b41cb653e644cd3bb09399f3ccc3e4b', 'request_id': 'req-6af5a4d7-6465-4916-8bf3-6b04e937d75a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:48.208196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b41cb653e644cd3bb09399f3ccc3e4b', 'request_id': 'req-6af5a4d7-6465-4916-8bf3-6b04e937d75a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:48.234054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] The token cache is being invalidate because project 8b41cb653e644cd3bb09399f3ccc3e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:48.234581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:48.236009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-6af5a4d7-6465-4916-8bf3-6b04e937d75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:48.239024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1083/2204] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:47 2022] DELETE /identity/v3/projects/8b41cb653e644cd3bb09399f3ccc3e4b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:48.250931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.253523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.254335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.295255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:48.296589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:48.416869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1122/2205] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:48.430022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.430446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.430899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.453401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:48.454750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:48.465016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1084/2206] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:48.471865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:48.484146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec4f6-7ec7-417b-a947-1b0fbc827c15 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:48.489555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.490352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.491151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.491151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.491658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:17:48.492128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.493857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.517818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1123/2207] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:17:48.522449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:48.534740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcee2c5-cacf-4f2e-a930-5b40d5aa899f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:48.539793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.540499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.541028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.541345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.542312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.544334 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.593027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1085/2208] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:48 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:48.597939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:48.614373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4571cf-6ca9-4d34-b8c4-e0d7f3943ec1 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:48.642383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:48.727752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.727752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.727752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.729475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.729475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.731335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.770288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1124/2209] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:48 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:48.775751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:48.791048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa684c-7fdd-4cf3-955d-04520fe215f6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:48.809290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.810710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.812811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.813311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.814832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.818013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.836481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1086/2210] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:48.840930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:48.854181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82428a26-8838-460e-a2dd-6b5fd9d1e56e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:48.861687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acd528-b8b1-4d1d-893f-ea7631e04e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.862826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd528-b8b1-4d1d-893f-ea7631e04e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.863323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd528-b8b1-4d1d-893f-ea7631e04e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.863798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acd528-b8b1-4d1d-893f-ea7631e04e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.865171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd528-b8b1-4d1d-893f-ea7631e04e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.868364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8acd528-b8b1-4d1d-893f-ea7631e04e37 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.892325 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1125/2211] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:48.898616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:48.911428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f4145-392e-4d8b-b436-e372ab784b1b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:48.916613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:48.917585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.917907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.918182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] PATH_INFO: `/v3/projects/585da920c23d491c9dc10b285793195f/users/ac876e65814e4033b45032202d65ebd3/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:48.934933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585da920c23d491c9dc10b285793195f, user_id=ac876e65814e4033b45032202d65ebd3, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:48.937749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:48.955758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1087/2212] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:48 2022] PUT /identity/v3/projects/585da920c23d491c9dc10b285793195f/users/ac876e65814e4033b45032202d65ebd3/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:48.967442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:48.967875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:48.969098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.008221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] MFA Rules not processed for user `ac876e65814e4033b45032202d65ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:49.009540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:49.109022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1126/2213] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:49.113923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:49.164874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:49.202267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7310a-b447-4835-b995-eec486091353 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:49.208443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:49.209099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.209521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.209807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.210491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:49.212486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:49.247167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1088/2214] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:49.252561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:49.267750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669afc41-a1ac-4e27-9712-1eab779cc080 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:49.375548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:49.380608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.381234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.381757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.382787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:49.385896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:49.420042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1127/2215] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:49 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:49.425820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:49.441355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eb04c-c95d-4085-a5c5-fd493e1ad218 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:49.448386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:49.449582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.449803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.450004 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.450776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:49.452447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:49.465951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1089/2216] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:49.470750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:49.488014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def5620-9dec-43f1-8076-bfdd0627dead admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:49.494623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720416b-e675-483b-b505-d13dc2f811c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:49.495316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720416b-e675-483b-b505-d13dc2f811c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.495595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720416b-e675-483b-b505-d13dc2f811c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.496011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720416b-e675-483b-b505-d13dc2f811c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.497555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720416b-e675-483b-b505-d13dc2f811c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:49.499217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720416b-e675-483b-b505-d13dc2f811c7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:49.513972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1128/2217] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:49.518596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:49.530200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edd197-1987-4931-8f00-bb58df528e9f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:49.536777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:49.537741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.538020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.538292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] PATH_INFO: `/v3/projects/d96989cafbee4bbb8f1e99020650182c/users/2acc414b787a41ff84724ab468644f64/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.558148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96989cafbee4bbb8f1e99020650182c, user_id=2acc414b787a41ff84724ab468644f64, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:49.561197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:49.592298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1090/2218] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:49 2022] PUT /identity/v3/projects/d96989cafbee4bbb8f1e99020650182c/users/2acc414b787a41ff84724ab468644f64/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:49.608007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.608632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.609250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.634074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:49.660475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] MFA Rules not processed for user `2acc414b787a41ff84724ab468644f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:49.662327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:49.785383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1129/2219] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:49.787883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:49.957720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255d88e-cb52-40ca-861f-b322f5a39666 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:49.972182 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:49.973358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:49.973874 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:49.974366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:49.975725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:49.979492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:50.022817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1091/2220] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:17:50.024252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:50.041352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b980625-7539-498c-a64b-f02eca5aed27 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:50.129487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:50.130206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.130492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.130768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:50.131500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:50.133680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:50.165035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1130/2221] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:17:50 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:17:50.172496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:50.187419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7ee4-ddb7-4837-b2da-4082e0b9d127 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:50.192623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:50.193360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.193677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.193939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:50.194700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:50.196410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:50.219045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1092/2222] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:50.225840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:50.243547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557d857-adc5-4fe9-b6e7-8dfaec03dd06 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:50.250978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:50.252445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.252897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.253497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] PATH_INFO: `/v3/projects/755a3185ccb04420a3aeacd78d6d2749/users/bd8a4b7479b54f158a13a50d76e48b76/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:50.281915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=755a3185ccb04420a3aeacd78d6d2749, user_id=bd8a4b7479b54f158a13a50d76e48b76, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:50.286878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:50.331061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1131/2223] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:50 2022] PUT /identity/v3/projects/755a3185ccb04420a3aeacd78d6d2749/users/bd8a4b7479b54f158a13a50d76e48b76/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:50.336494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:50.407964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72af4a-9dca-4037-83fb-10838711225c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:50.429300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:50.489776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb76ee-836d-479e-8411-bb915092e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:50.490704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb76ee-836d-479e-8411-bb915092e549 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.491776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb76ee-836d-479e-8411-bb915092e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.492077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb76ee-836d-479e-8411-bb915092e549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:50.493084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb76ee-836d-479e-8411-bb915092e549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:50.495039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb76ee-836d-479e-8411-bb915092e549 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:50.510773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1093/2224] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:17:50.514022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:50.581471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b9de-3ea8-43ca-813f-a6c9101eee0b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:50.588024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:50.590276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.590739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.591188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] PATH_INFO: `/v3/projects/755a3185ccb04420a3aeacd78d6d2749/users/bd8a4b7479b54f158a13a50d76e48b76/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:50.593532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] RBAC: Authorizing `identity:create_grant(project_id=755a3185ccb04420a3aeacd78d6d2749, user_id=bd8a4b7479b54f158a13a50d76e48b76, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:50.597367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:50.613600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1132/2225] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:17:50 2022] PUT /identity/v3/projects/755a3185ccb04420a3aeacd78d6d2749/users/bd8a4b7479b54f158a13a50d76e48b76/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:50.628867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.629211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.629486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:50.687589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] MFA Rules not processed for user `bd8a4b7479b54f158a13a50d76e48b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:50.689128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:50.791402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1094/2226] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:50.806286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:50.808730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:50.813374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:50.928123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbf7fc-0431-4778-b386-46d833e736db admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:50.932595 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:50.933690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:50.934116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:50.934878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:51.028086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:51.029797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:51.040934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1133/2227] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:52.739795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:52.751549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2d22e-6451-44a3-b20b-f132e1ed6815 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:52.756148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:52.756824 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:52.757116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:52.757417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:52.825487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:52.827327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:52.838428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1095/2228] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:53.509859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:53.519916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279f4f-12fb-4493-817f-7fb6b619c5da service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:53.523885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d31d35-0065-4f1f-92cb-efcd2249eea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:53.524552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31d35-0065-4f1f-92cb-efcd2249eea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:53.524833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31d35-0065-4f1f-92cb-efcd2249eea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:53.525107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d31d35-0065-4f1f-92cb-efcd2249eea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:53.537241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31d35-0065-4f1f-92cb-efcd2249eea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:53.538762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d31d35-0065-4f1f-92cb-efcd2249eea5 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:53.550766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1134/2229] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:57.747414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:57.805871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:57.869094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd10a6-4a63-4369-89f7-8a30a0a9974a service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:57.881106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:57.883048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:57.889556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:57.889970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] PATH_INFO: `/v3/users/ac876e65814e4033b45032202d65ebd3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:57.892234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac876e65814e4033b45032202d65ebd3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:57.894785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:57.968631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac876e65814e4033b45032202d65ebd3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:57.979780 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac876e65814e4033b45032202d65ebd3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:57.990853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac876e65814e4033b45032202d65ebd3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:57.998577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac876e65814e4033b45032202d65ebd3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.031938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac876e65814e4033b45032202d65ebd3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.041816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1096/2230] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:57 2022] DELETE /identity/v3/users/ac876e65814e4033b45032202d65ebd3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:58.046868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20e92b-4fd0-4364-aaef-996a80bc7698 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:58.047494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20e92b-4fd0-4364-aaef-996a80bc7698 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:58.047494 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20e92b-4fd0-4364-aaef-996a80bc7698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:58.081592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ca20e92b-4fd0-4364-aaef-996a80bc7698 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:58.082825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ca20e92b-4fd0-4364-aaef-996a80bc7698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:58.173934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1135/2231] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:17:58.186456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:58.187912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:58.331893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997c37c-6580-4737-b1f3-d35e7e9fa6fd admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:58.336399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:58.337068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:58.337369 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:58.337652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:58.349201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:58.350732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:58.363244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1097/2232] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:17:58.500069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:58.500360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:58.500640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:58.521074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] MFA Rules not processed for user `c10fe54c24554b4db6783014a85cfa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:17:58.522352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:58.554401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:58.614300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1136/2233] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:17:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:17:58.752821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:58.754817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:58.769675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef235d-3b5a-4b12-a315-1e888fbc313a service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:58.780599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:58.782129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:58.782570 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:58.782859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] PATH_INFO: `/v3/projects/585da920c23d491c9dc10b285793195f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:58.784535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585da920c23d491c9dc10b285793195f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:58.786779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:58.851579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:58.874951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585da920c23d491c9dc10b285793195f', 'request_id': 'req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.887529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585da920c23d491c9dc10b285793195f', 'request_id': 'req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.898923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585da920c23d491c9dc10b285793195f', 'request_id': 'req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.919413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] The token cache is being invalidate because project 585da920c23d491c9dc10b285793195f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:58.919896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.920962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:58.924224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1098/2234] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:58 2022] DELETE /identity/v3/projects/585da920c23d491c9dc10b285793195f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:58.929339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:58.949233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac870b-0193-4969-b39f-c864b4d8a1c9 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:59.025977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:59.028155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:59.028554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:59.029125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] PATH_INFO: `/v3/users/2acc414b787a41ff84724ab468644f64` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:59.031902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acc414b787a41ff84724ab468644f64)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:59.034988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:59.116948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acc414b787a41ff84724ab468644f64'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.127832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acc414b787a41ff84724ab468644f64'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.128977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acc414b787a41ff84724ab468644f64'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.161119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acc414b787a41ff84724ab468644f64'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.178367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acc414b787a41ff84724ab468644f64'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.186573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1137/2235] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:58 2022] DELETE /identity/v3/users/2acc414b787a41ff84724ab468644f64 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:17:59.695524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:59.698404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:59.725617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0bf2a-1983-48f0-9fc5-6ef21527f6b0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:59.792046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:59.792971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:59.793259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:59.793752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] PATH_INFO: `/v3/projects/d96989cafbee4bbb8f1e99020650182c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:59.795343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96989cafbee4bbb8f1e99020650182c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:59.796891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:17:59.852436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96989cafbee4bbb8f1e99020650182c', 'request_id': 'req-ed62a258-929d-475e-84ea-42953f30b42d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.866858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96989cafbee4bbb8f1e99020650182c', 'request_id': 'req-ed62a258-929d-475e-84ea-42953f30b42d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.875589 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96989cafbee4bbb8f1e99020650182c', 'request_id': 'req-ed62a258-929d-475e-84ea-42953f30b42d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.887356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] The token cache is being invalidate because project d96989cafbee4bbb8f1e99020650182c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:17:59.887650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.888499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:17:59.890665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1099/2236] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:17:59 2022] DELETE /identity/v3/projects/d96989cafbee4bbb8f1e99020650182c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:17:59.894939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:17:59.896713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:17:59.912017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4a1a-df54-481a-babc-ba1a58d1b9e4 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:17:59.971432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:17:59.985721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:17:59.986626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:17:59.986903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:17:59.987174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] PATH_INFO: `/v3/users/bd8a4b7479b54f158a13a50d76e48b76` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:17:59.988387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8a4b7479b54f158a13a50d76e48b76)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:17:59.990375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:00.044963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8a4b7479b54f158a13a50d76e48b76'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.054440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8a4b7479b54f158a13a50d76e48b76'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.055100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8a4b7479b54f158a13a50d76e48b76'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.073451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8a4b7479b54f158a13a50d76e48b76'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.083278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9963b7ba-4cb2-4f12-b908-5c6915690176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8a4b7479b54f158a13a50d76e48b76'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.090147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1138/2237] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:17:59 2022] DELETE /identity/v3/users/bd8a4b7479b54f158a13a50d76e48b76 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:00.395738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:00.397487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:00.411838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62a258-929d-475e-84ea-42953f30b42d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:00.463957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:00.488389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:00.490620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:00.491095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:00.491724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] PATH_INFO: `/v3/projects/755a3185ccb04420a3aeacd78d6d2749` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:00.494676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755a3185ccb04420a3aeacd78d6d2749)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:00.499279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:00.573265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755a3185ccb04420a3aeacd78d6d2749', 'request_id': 'req-e239752a-4051-4a62-a63a-0b8c5b699557'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.585138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755a3185ccb04420a3aeacd78d6d2749', 'request_id': 'req-e239752a-4051-4a62-a63a-0b8c5b699557'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.593594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755a3185ccb04420a3aeacd78d6d2749', 'request_id': 'req-e239752a-4051-4a62-a63a-0b8c5b699557'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.610938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] The token cache is being invalidate because project 755a3185ccb04420a3aeacd78d6d2749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:18:00.611308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.614321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e239752a-4051-4a62-a63a-0b8c5b699557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:00.616208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1100/2238] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:18:00 2022] DELETE /identity/v3/projects/755a3185ccb04420a3aeacd78d6d2749 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:00.621829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:00.622288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:00.622472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:00.666220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:00.667452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:00.775515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1139/2239] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:00.784558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:00.784881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:00.785308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:00.805226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:00.806520 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:00.816437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1101/2240] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:18:00.822073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:00.847614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd57fa-1455-4834-81f0-95c0a41b7b8f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:00.853741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:00.854596 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:00.854879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:00.855221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:00.855991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:18:00.856514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:00.858628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:00.872384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1140/2241] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:18:00.877010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:00.887002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740197-5846-4f47-97a2-d422efba8f44 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:00.893687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:00.894564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:00.895195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:00.895195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:00.895830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:00.897990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:00.935334 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1102/2242] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:18:00 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:18:00.940945 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:00.953581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb8a1b-2f01-4df3-ad4f-2a81aeb24f1f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:01.009195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:01.035421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:01.036118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:01.036395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:01.036669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:01.037399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:01.039354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:01.068160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1141/2243] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:18:00 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:18:01.074475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:01.086132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742c841-21b4-404f-bca0-15d2b6a4ca2c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:01.092238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:01.093054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:01.093463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:01.093858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:01.094737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:01.096511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:01.109203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1103/2244] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:18:01.115194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:01.127012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fece72-179f-4675-a1ff-661fd6e67c81 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:01.132625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca4fc8-022f-4a28-8118-204e136a57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:01.133379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca4fc8-022f-4a28-8118-204e136a57f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:01.133666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca4fc8-022f-4a28-8118-204e136a57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:01.133931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca4fc8-022f-4a28-8118-204e136a57f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:01.134680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca4fc8-022f-4a28-8118-204e136a57f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:01.136304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca4fc8-022f-4a28-8118-204e136a57f9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:01.148484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1142/2245] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:18:01.154404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:01.174932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd16e8e-6517-42ac-9760-a540e0f0848e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:01.180482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:01.181591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:01.181877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:01.182153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] PATH_INFO: `/v3/projects/5768c0a49dc3445f968ab824ef106171/users/9c61a57737244fab84949dfccaacf368/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:01.200393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5768c0a49dc3445f968ab824ef106171, user_id=9c61a57737244fab84949dfccaacf368, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:01.203300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:01.218862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1104/2246] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:18:01 2022] PUT /identity/v3/projects/5768c0a49dc3445f968ab824ef106171/users/9c61a57737244fab84949dfccaacf368/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:01.235041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1958a-287a-454b-861f-f988a0cfb69e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:01.235543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1958a-287a-454b-861f-f988a0cfb69e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:01.236008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1958a-287a-454b-861f-f988a0cfb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:01.268288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c6c1958a-287a-454b-861f-f988a0cfb69e None None] MFA Rules not processed for user `9c61a57737244fab84949dfccaacf368`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:01.269684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c6c1958a-287a-454b-861f-f988a0cfb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:01.351931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1143/2247] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:01.365067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:01.366870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:01.449808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538cf7d-a838-469c-ac33-65d9fde4e526 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:01.455678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:01.456474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:01.456847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:01.457204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:01.468865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:01.470454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:01.481068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1105/2248] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:18:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:18:03.021762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:03.022390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:03.022390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:03.044156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:03.045586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:03.133656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1144/2249] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:18:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:03.146691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:03.148354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:03.173394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:03.273791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7030-e297-4e17-84ca-1cb02d4cbbb8 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:03.281547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb3715-f651-426e-9ecd-36f512e595d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:03.282676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb3715-f651-426e-9ecd-36f512e595d7 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:03.283120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb3715-f651-426e-9ecd-36f512e595d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:03.283538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb3715-f651-426e-9ecd-36f512e595d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:03.294075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb3715-f651-426e-9ecd-36f512e595d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:03.295845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb3715-f651-426e-9ecd-36f512e595d7 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:03.308063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1106/2250] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:18:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:18:11.111815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:11.227454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:11.247504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cea15-ad9f-4049-b061-32fbb9473c1d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:11.261926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:11.263273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:11.263763 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:11.264279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] PATH_INFO: `/v3/users/9c61a57737244fab84949dfccaacf368` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:11.279056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c61a57737244fab84949dfccaacf368)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:11.284125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:11.394571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c61a57737244fab84949dfccaacf368'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:11.407666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c61a57737244fab84949dfccaacf368'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:11.408685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c61a57737244fab84949dfccaacf368'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:11.444895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c61a57737244fab84949dfccaacf368'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:11.467327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c61a57737244fab84949dfccaacf368'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:11.502141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1145/2251] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:18:11 2022] DELETE /identity/v3/users/9c61a57737244fab84949dfccaacf368 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:11.506763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:11.507279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:11.507361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:11.571166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:11.572454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:11.710607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1107/2252] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:11.722252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:11.724098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:11.848940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ecff4-a052-47b9-a41f-2770dc970b5e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:11.855121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9398e-5c98-49f7-a218-b50853425678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:11.856435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9398e-5c98-49f7-a218-b50853425678 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:11.856818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9398e-5c98-49f7-a218-b50853425678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:11.857440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9398e-5c98-49f7-a218-b50853425678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:11.872626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9398e-5c98-49f7-a218-b50853425678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:11.874524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9398e-5c98-49f7-a218-b50853425678 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:11.894465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1146/2253] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:18:12.514095 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:12.515963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:12.564980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cabbe-1a44-4bb6-a076-53cbb0fd287f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:12.584294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:12.585194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:12.585531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:12.585803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] PATH_INFO: `/v3/projects/5768c0a49dc3445f968ab824ef106171` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:12.587269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5768c0a49dc3445f968ab824ef106171)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:12.590737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:12.713054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5768c0a49dc3445f968ab824ef106171', 'request_id': 'req-333503c6-f97d-4149-8067-f8697fc8887c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:12.751672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5768c0a49dc3445f968ab824ef106171', 'request_id': 'req-333503c6-f97d-4149-8067-f8697fc8887c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:12.773107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5768c0a49dc3445f968ab824ef106171', 'request_id': 'req-333503c6-f97d-4149-8067-f8697fc8887c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:12.791544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] The token cache is being invalidate because project 5768c0a49dc3445f968ab824ef106171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:18:12.792093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:12.792958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-333503c6-f97d-4149-8067-f8697fc8887c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:12.795501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1108/2254] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:18:12 2022] DELETE /identity/v3/projects/5768c0a49dc3445f968ab824ef106171 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:19.328058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:19.329201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:19.329671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:19.351909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] MFA Rules not processed for user `9be9445fdbc4459da4feb7c0bc1b310f`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:19.353625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:19.440107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1147/2255] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:22.783368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:26.484259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:26.485365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:26.485365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:26.525810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:26.527311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:26.602761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1109/2256] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 15 22:18:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:26.631648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:26.634322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:26.668674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:26.739251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4845a-9641-4ba5-9477-8c3e67e58720 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:26.744777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:26.745497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:26.745784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:26.746063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:26.761296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:26.765790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:26.775138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1148/2257] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 22:18:31.254297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:31.255837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:31.334897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9347e-c0cb-471e-bae1-2bd689231545 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:31.339939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:31.341044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:31.341421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:31.341758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] PATH_INFO: `/v3/users/3955b4cf3ef54207b09d7008906221e7` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:31.343247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3955b4cf3ef54207b09d7008906221e7)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:31.345792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:31.411846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3955b4cf3ef54207b09d7008906221e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.420521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3955b4cf3ef54207b09d7008906221e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.427959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3955b4cf3ef54207b09d7008906221e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.428807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3955b4cf3ef54207b09d7008906221e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.442868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-52afbd0e-c20d-4dff-94c0-e6ab53c8d915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3955b4cf3ef54207b09d7008906221e7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.451293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1110/2258] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:18:31 2022] DELETE /identity/v3/users/3955b4cf3ef54207b09d7008906221e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:18:31.741572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:31.754430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906aeb0-8f1a-4b8d-8b87-7c3246f4d7f1 service swift] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:31.841914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:31.842824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:31.843113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:31.843393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] PATH_INFO: `/v3/projects/f8635efdd4ea406eabfb397bdfd83d07` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:31.844822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8635efdd4ea406eabfb397bdfd83d07)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:31.847034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:31.918113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8635efdd4ea406eabfb397bdfd83d07', 'request_id': 'req-77ef8396-4fca-4923-bf97-1192e1afc8d4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.925246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8635efdd4ea406eabfb397bdfd83d07', 'request_id': 'req-77ef8396-4fca-4923-bf97-1192e1afc8d4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.934193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8635efdd4ea406eabfb397bdfd83d07', 'request_id': 'req-77ef8396-4fca-4923-bf97-1192e1afc8d4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.950858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] The token cache is being invalidate because project f8635efdd4ea406eabfb397bdfd83d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:18:31.951154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.952064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-77ef8396-4fca-4923-bf97-1192e1afc8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:18:31.957363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1149/2259] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:18:31 2022] DELETE /identity/v3/projects/f8635efdd4ea406eabfb397bdfd83d07 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:31.959578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:31.960075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:31.960571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:31.989442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:32.022568 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:32.023826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:32.105951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1111/2260] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:32.114780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.115091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.115405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.138778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:32.140036 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:32.149896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1150/2261] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:32.157702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.169132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e34a35-5771-4546-8f98-28a07a7c0a03 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.174405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.175108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.175393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.175672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.176492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:18:32.176808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.178539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.192315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1112/2262] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:18:32.197009 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.207878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f1a5a-c32e-4707-877b-cede622f3d8c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.212627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.213350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.213600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.213868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.214587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.217306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.272308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1151/2263] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:18:32 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:18:32.276436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.290832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e6d5f-8406-45ec-bd89-2b9bde3ddda6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.366489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.367572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.368071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.368558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.369499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.371621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.403014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1113/2264] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:18:32 2022] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:18:32.407979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.418904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aaab0-0475-432f-a570-9783af7a12c3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.425598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.426223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.426505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.426776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.427514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.429345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.439703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:32.442782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1152/2265] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:18:32.447029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.458533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068d56-2c01-4203-8ef9-155a96a98d42 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.463419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b5a39-2184-464c-854f-af3ecd84dab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.464115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b5a39-2184-464c-854f-af3ecd84dab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.464394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b5a39-2184-464c-854f-af3ecd84dab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.464667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b5a39-2184-464c-854f-af3ecd84dab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.465680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b5a39-2184-464c-854f-af3ecd84dab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.467705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b5a39-2184-464c-854f-af3ecd84dab5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.479993 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1114/2266] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:18:32.484526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.497463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e7c1-4169-47c0-b1c1-320c4040d158 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.504843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.505942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.506289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.506634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] PATH_INFO: `/v3/projects/374e299de0ed4c39bb0c68f2f94c6b82/users/7701c16e18884e9bbc2756f1e5f53f4c/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.524785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374e299de0ed4c39bb0c68f2f94c6b82, user_id=7701c16e18884e9bbc2756f1e5f53f4c, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.528377 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.551988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1153/2267] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:18:32 2022] PUT /identity/v3/projects/374e299de0ed4c39bb0c68f2f94c6b82/users/7701c16e18884e9bbc2756f1e5f53f4c/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:18:32.570281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.570691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.571179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.613587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] MFA Rules not processed for user `7701c16e18884e9bbc2756f1e5f53f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:32.617893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:32.697198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:32.711351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1115/2268] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:18:32.724635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:32.729100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:32.826134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82bfaef-be88-41a2-822c-8c9b5a6cb999 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:32.830136 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cdcfa-41a1-41df-b55f-d76efa7b5a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:32.830849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdcfa-41a1-41df-b55f-d76efa7b5a97 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:32.831123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdcfa-41a1-41df-b55f-d76efa7b5a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:32.831469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdcfa-41a1-41df-b55f-d76efa7b5a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:32.843095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cdcfa-41a1-41df-b55f-d76efa7b5a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:32.844567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cdcfa-41a1-41df-b55f-d76efa7b5a97 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:32.855310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1154/2269] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:18:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:18:40.797547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:18:40.798919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:40.939638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460503b7-5bc3-4c24-97ab-9c486c1cffa8 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:18:40.945061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:18:40.946286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:40.946286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:40.946522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:40.948704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:40.966192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:18:40.968079 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e4303-b1da-42d6-bc4c-99b343c503ea service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:18:40.980736 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1116/2270] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:18:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:18:42.850599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:50.975555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=43 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:18:57.019398 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:18:57.020146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:18:57.020146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:18:57.040713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] MFA Rules not processed for user `c603735d259e4ea390006779d4e76575`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:18:57.042001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:18:57.115991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1155/2271] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:18:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:19:07.107157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=25 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:14.396882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:14.397567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:14.397672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:14.473271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:19:14.475075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:14.551433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1117/2272] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:19:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:19:14.564203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:14.565993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:14.679186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add78b36-a931-4ca5-b1ee-dd3764435c5d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:14.688156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503efe2-438b-4ff2-86bd-9340053b2890 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:14.689352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503efe2-438b-4ff2-86bd-9340053b2890 service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:14.689889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503efe2-438b-4ff2-86bd-9340053b2890 service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:14.690367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503efe2-438b-4ff2-86bd-9340053b2890 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:14.706547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503efe2-438b-4ff2-86bd-9340053b2890 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:14.709788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503efe2-438b-4ff2-86bd-9340053b2890 service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:14.725779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1156/2273] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:19:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:19:15.118847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:15.192016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d153e-3ac9-4181-a043-89bd37b7b731 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:15.198035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:15.198986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:15.199253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:15.199526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] PATH_INFO: `/v3/users/7701c16e18884e9bbc2756f1e5f53f4c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:15.200803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7701c16e18884e9bbc2756f1e5f53f4c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:15.202785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:15.277087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7701c16e18884e9bbc2756f1e5f53f4c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:15.287486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7701c16e18884e9bbc2756f1e5f53f4c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:15.300607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7701c16e18884e9bbc2756f1e5f53f4c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:15.301729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7701c16e18884e9bbc2756f1e5f53f4c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:15.313205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:15.320015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7701c16e18884e9bbc2756f1e5f53f4c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:15.332955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1118/2274] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:19:15 2022] DELETE /identity/v3/users/7701c16e18884e9bbc2756f1e5f53f4c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:19:15.337787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:15.338225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:15.338477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:15.362736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:19:15.363962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:15.451575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1157/2275] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:19:15.460619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:15.462330 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:15.599126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f183-cd40-4269-8d03-f939c50d028a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:15.622849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cab34-c457-43ed-a79c-430a544883ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:15.623442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cab34-c457-43ed-a79c-430a544883ca service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:15.623854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cab34-c457-43ed-a79c-430a544883ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:15.624376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cab34-c457-43ed-a79c-430a544883ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:15.644423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cab34-c457-43ed-a79c-430a544883ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:15.651142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cab34-c457-43ed-a79c-430a544883ca service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:15.676013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1119/2276] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:19:16.086764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:16.089202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:16.117744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae2057-c4e2-45ca-8ada-5a671820895d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:16.123499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:16.124420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:16.124708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:16.124993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] PATH_INFO: `/v3/projects/374e299de0ed4c39bb0c68f2f94c6b82` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:16.126478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374e299de0ed4c39bb0c68f2f94c6b82)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:16.128577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:16.184541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374e299de0ed4c39bb0c68f2f94c6b82', 'request_id': 'req-7543e280-7f77-42ab-9bd8-0893aad06502'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:16.196356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374e299de0ed4c39bb0c68f2f94c6b82', 'request_id': 'req-7543e280-7f77-42ab-9bd8-0893aad06502'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:16.211518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374e299de0ed4c39bb0c68f2f94c6b82', 'request_id': 'req-7543e280-7f77-42ab-9bd8-0893aad06502'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:16.214169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:16.243203 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] The token cache is being invalidate because project 374e299de0ed4c39bb0c68f2f94c6b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:19:16.243537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:16.244298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7543e280-7f77-42ab-9bd8-0893aad06502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:19:16.246308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1158/2277] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:19:16 2022] DELETE /identity/v3/projects/374e299de0ed4c39bb0c68f2f94c6b82 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:19:25.664191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=29,keystone:DELETE=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:26.238333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:31.027295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3691f8-5935-4881-84ad-06b4226444cf None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.027830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3691f8-5935-4881-84ad-06b4226444cf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.028651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3691f8-5935-4881-84ad-06b4226444cf None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.033596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1120/2278] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:19:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:19:31.042005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c28f6-f0f3-422c-b1a5-5dc31b15036f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.042995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c28f6-f0f3-422c-b1a5-5dc31b15036f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.043575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c28f6-f0f3-422c-b1a5-5dc31b15036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.114335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ac5c28f6-f0f3-422c-b1a5-5dc31b15036f None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:19:31.118749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ac5c28f6-f0f3-422c-b1a5-5dc31b15036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:31.241562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1159/2279] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:19:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:19:31.253145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3691f8-5935-4881-84ad-06b4226444cf None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:31.256371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7b3691f8-5935-4881-84ad-06b4226444cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:31.363991 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3691f8-5935-4881-84ad-06b4226444cf None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:31.367670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7d07f-c2ac-4d0c-817b-a641d71079f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:31.368334 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7d07f-c2ac-4d0c-817b-a641d71079f5 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.368618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7d07f-c2ac-4d0c-817b-a641d71079f5 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.368911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7d07f-c2ac-4d0c-817b-a641d71079f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.380270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7d07f-c2ac-4d0c-817b-a641d71079f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:31.381987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7d07f-c2ac-4d0c-817b-a641d71079f5 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:31.395007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1121/2280] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:19:31.482147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3dc0-3b5b-4388-ad68-7b5e928e926f None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.482652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3dc0-3b5b-4388-ad68-7b5e928e926f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.483120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a3dc0-3b5b-4388-ad68-7b5e928e926f None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.484829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1160/2281] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:19:31.490475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b62c-2a2a-4988-aa84-77f900063e07 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.490952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b62c-2a2a-4988-aa84-77f900063e07 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.491349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8b62c-2a2a-4988-aa84-77f900063e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.522427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-daf8b62c-2a2a-4988-aa84-77f900063e07 None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:19:31.523820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-daf8b62c-2a2a-4988-aa84-77f900063e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:31.612853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1122/2282] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:19:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:19:31.626523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3dc0-3b5b-4388-ad68-7b5e928e926f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:31.628502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6b7a3dc0-3b5b-4388-ad68-7b5e928e926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:31.643977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a3dc0-3b5b-4388-ad68-7b5e928e926f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:31.648992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413be35-9b0e-4e3b-a7d1-3c25f25cf591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:31.649716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413be35-9b0e-4e3b-a7d1-3c25f25cf591 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.649999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413be35-9b0e-4e3b-a7d1-3c25f25cf591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.650407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413be35-9b0e-4e3b-a7d1-3c25f25cf591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.660448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413be35-9b0e-4e3b-a7d1-3c25f25cf591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:31.662002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413be35-9b0e-4e3b-a7d1-3c25f25cf591 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:31.671103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1161/2283] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:19:31.763185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd5325-e99e-44f3-b0d2-087d3137143c None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.763467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd5325-e99e-44f3-b0d2-087d3137143c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.763739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd5325-e99e-44f3-b0d2-087d3137143c None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.765199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1123/2284] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:19:31.771496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77360d7-321b-4d55-8be0-6f9d2f427f25 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.771806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77360d7-321b-4d55-8be0-6f9d2f427f25 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.772143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77360d7-321b-4d55-8be0-6f9d2f427f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.794131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f77360d7-321b-4d55-8be0-6f9d2f427f25 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:19:31.795268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f77360d7-321b-4d55-8be0-6f9d2f427f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:31.806904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1162/2285] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:19:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:19:31.818121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd5325-e99e-44f3-b0d2-087d3137143c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:31.820582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-23cd5325-e99e-44f3-b0d2-087d3137143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:31.838185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd5325-e99e-44f3-b0d2-087d3137143c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:31.842001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:31.842730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:31.843033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:31.843721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:31.856604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:31.859240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:31.873434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1124/2286] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:19:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:19:36.899702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:36.900978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:36.901484 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:36.923333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:19:36.924566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:37.001995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1163/2287] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:19:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:19:37.015329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:19:37.016945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:19:37.107581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a64b-966f-4c31-ba30-f6232bb6da14 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:19:37.114061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:19:37.114749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:19:37.115035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:19:37.115301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:19:37.125308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:19:37.127000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:19:37.136783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1125/2288] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:19:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:19:46.989630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=80 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:19:47.133388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:01.642386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:01.644967 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:01.737085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47911b9d-d08a-429a-81dc-55ca9517fc1f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:01.742218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:01.743126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:01.743432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:01.743905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] PATH_INFO: `/v3/users/c603735d259e4ea390006779d4e76575` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:01.745207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c603735d259e4ea390006779d4e76575)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:01.747368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:01.821181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c603735d259e4ea390006779d4e76575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:01.838074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c603735d259e4ea390006779d4e76575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:01.838699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c603735d259e4ea390006779d4e76575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:01.852372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c603735d259e4ea390006779d4e76575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:01.860000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-2f56c271-a578-4526-b92b-2b9f98bb1978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c603735d259e4ea390006779d4e76575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:01.868048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1164/2289] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:20:01 2022] DELETE /identity/v3/users/c603735d259e4ea390006779d4e76575 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:20:02.075703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:02.093500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5296527-5b80-49bd-a041-e2ddfb3646b8 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:02.223312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:02.223984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:02.224486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:02.246454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:02.247393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:02.247998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:02.249839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] PATH_INFO: `/v3/projects/1c2773d61c84492fb70a7a59cffa6fdb` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:02.251948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2773d61c84492fb70a7a59cffa6fdb)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:02.254558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:20:02.254878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:02.255834 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:02.350040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2773d61c84492fb70a7a59cffa6fdb', 'request_id': 'req-b487de3b-1803-4ee8-a793-8dfa3deaa93c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:02.364169 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2773d61c84492fb70a7a59cffa6fdb', 'request_id': 'req-b487de3b-1803-4ee8-a793-8dfa3deaa93c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:02.378580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2773d61c84492fb70a7a59cffa6fdb', 'request_id': 'req-b487de3b-1803-4ee8-a793-8dfa3deaa93c'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:02.386978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1165/2290] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 15 22:20:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:20:02.399101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] The token cache is being invalidate because project 1c2773d61c84492fb70a7a59cffa6fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:20:02.399396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:02.400122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b487de3b-1803-4ee8-a793-8dfa3deaa93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:20:02.402247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1126/2291] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:20:02 2022] DELETE /identity/v3/projects/1c2773d61c84492fb70a7a59cffa6fdb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:20:02.414869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:02.416535 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:02.460071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:02.522220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2855ece-17dc-4b2a-a77e-e3ec3ab819f4 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:02.600093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:02.600796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:02.601097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:02.601430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:02.603784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:02.667613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:02.669244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab4886-d128-4b9a-b5ce-ef7b5778a132 service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:02.678814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1166/2292] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:20:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:20:05.552950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:05.553564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:05.553564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:05.573776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] MFA Rules not processed for user `c10fe54c24554b4db6783014a85cfa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:20:05.575098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:05.643917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1127/2293] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:20:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:20:10.841942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:10.842554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:10.842653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:10.862242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] MFA Rules not processed for user `9be9445fdbc4459da4feb7c0bc1b310f`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:20:10.863861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:10.938450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1167/2294] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:20:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:20:15.636940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:20.930886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=94 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:20:43.055171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:43.056760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:43.124158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e18e42-fcd4-409a-9f0b-0e9b8641ea2b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:43.128333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:43.128976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:43.129253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:43.129542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:43.131934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:43.208768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:43.210477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a219578-1951-4c1a-bd3d-476685085e95 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:43.225601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1128/2295] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:20:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:20:45.831779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:45.841055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:45.909160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452ccf6-7761-451d-9f86-1531dfb29f25 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:45.913436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:45.914083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:45.914364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:45.914636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:45.916927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:45.930906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:45.932338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:45.943504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1168/2296] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:20:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:20:51.543224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda73558-2851-4aa0-846c-96356e154480 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:51.543840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda73558-2851-4aa0-846c-96356e154480 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:51.543840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda73558-2851-4aa0-846c-96356e154480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:51.569977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fda73558-2851-4aa0-846c-96356e154480 None None] MFA Rules not processed for user `97aa07a49016448d9b1067ce0dbd8d99`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:20:51.571732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fda73558-2851-4aa0-846c-96356e154480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:51.634453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1129/2297] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:20:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:20:53.329452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:53.339975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82406c7-bbe4-4f82-8352-228ab8cd1f87 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:53.345409 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:53.346129 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:53.346308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:53.346562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:53.354295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:53.423586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:53.425060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:53.435138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1169/2298] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:20:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:20:56.618711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda73558-2851-4aa0-846c-96356e154480 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:56.629773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda73558-2851-4aa0-846c-96356e154480 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:56.633510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:56.634166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:56.634442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:56.634712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:56.636937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:56.649153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:56.650649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db32b7-571d-4aa6-ba79-a22d5239119f service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:56.661010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1130/2299] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:20:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:20:57.780496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:20:57.781909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:57.831324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e1bc2-7087-43bc-942d-a46ccf6613ab service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:20:57.844709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:20:57.846615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:20:57.847072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:20:57.847518 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:20:57.850806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:20:57.870044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:20:57.872189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:20:57.883527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1170/2300] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:20:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:04.804841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:04.805313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:04.805481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:04.823232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] MFA Rules not processed for user `728f1fbe76564467b378035d0d2d3be5`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:04.824507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:04.833562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1131/2301] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:21:05.377871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:05.387811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121c44-8144-442d-9548-2b14d91a6994 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:05.392244 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:05.392927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:05.393254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:05.393573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:05.395507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:05.406713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:05.408245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:05.417085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1171/2302] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:05.825118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:05.826756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:05.832139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:05.907096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b55b4-ab6a-4e0d-b838-347e7d7ebf89 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:05.912356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:05.913076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:05.913428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:05.913791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:05.915601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:05.928204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:05.929942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:05.940522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1132/2303] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:06.901027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:06.903286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:06.924739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e01d31-4290-4b19-8125-f16eca847f1e service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:06.929588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:06.930258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:06.930831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:06.931108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:06.933748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:06.946165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:06.947968 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:06.965681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1172/2304] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:11.613062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:11.654281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d439ba-3907-415b-b002-3e421db3329b service placement] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:11.665259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:11.667519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:11.668097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:11.668813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:11.672399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:11.711582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:11.713274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:11.727742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1133/2305] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:12.101456 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:12.115773 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=73 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:12.121772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62ed5f-302e-4ea1-99cc-8f21e814f161 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:12.165752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:12.166863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:12.167334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:12.167774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:12.170342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:12.188024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:12.189874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0319b0-a964-4d53-b3a5-51b0dd7c08f1 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:12.203984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1173/2306] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:21.721445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=37 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:21.831305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:21.841421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde2ef0-e07d-4438-9fb2-a1a7b3b7cb13 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:21.845618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:21.846271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:21.846751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:21.847013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:21.849058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:21.923773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:21.925382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:21.936276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1134/2307] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:22.197624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:25.518890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:25.520110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:25.520858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:25.539725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] MFA Rules not processed for user `c10fe54c24554b4db6783014a85cfa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:25.541151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:25.549411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1174/2308] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:25.873605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:25.883092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79e1b-b03a-47c6-b527-691bf1cc9f76 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:25.887027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:25.887715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:25.887998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:25.888275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:25.890171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:25.900575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:25.902048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:25.910902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1135/2309] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:26.568259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:26.584416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e87e6-7473-4f9c-bc6a-e58e1bb5d3d2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:26.590944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:26.592159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:26.592159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:26.592956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:26.599438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:26.614327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:26.616056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:26.634930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1175/2310] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:26.644670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:26.651708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:26.670377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608b626-b079-4ab2-b9c6-25e7d0fc0c38 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:26.679996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:26.680897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:26.681214 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:26.681492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] PATH_INFO: `/v3/users/9be9445fdbc4459da4feb7c0bc1b310f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:26.682865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be9445fdbc4459da4feb7c0bc1b310f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:26.684961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:26.737715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be9445fdbc4459da4feb7c0bc1b310f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:26.747723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be9445fdbc4459da4feb7c0bc1b310f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:26.756012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be9445fdbc4459da4feb7c0bc1b310f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:26.756729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be9445fdbc4459da4feb7c0bc1b310f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:26.774559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7dbcec38-51ab-4b4e-a3c6-54dc0fd0caff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be9445fdbc4459da4feb7c0bc1b310f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:26.782398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1136/2311] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:21:26 2022] DELETE /identity/v3/users/9be9445fdbc4459da4feb7c0bc1b310f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:26.979074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:26.990668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176166c-6a80-44a8-ac67-8cbef3a57284 service placement] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.053814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.054798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.055084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.055358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] PATH_INFO: `/v3/projects/0713040636b4408c95dcadbb9b1fe3cc` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.056553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0713040636b4408c95dcadbb9b1fe3cc)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.058521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.116245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0713040636b4408c95dcadbb9b1fe3cc', 'request_id': 'req-984d5998-5f5f-44dd-a34a-2dca64181258'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:27.122114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0713040636b4408c95dcadbb9b1fe3cc', 'request_id': 'req-984d5998-5f5f-44dd-a34a-2dca64181258'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:27.129212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0713040636b4408c95dcadbb9b1fe3cc', 'request_id': 'req-984d5998-5f5f-44dd-a34a-2dca64181258'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:27.143659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] The token cache is being invalidate because project 0713040636b4408c95dcadbb9b1fe3cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:21:27.143947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:27.144726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-984d5998-5f5f-44dd-a34a-2dca64181258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:27.146395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1176/2312] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:21:26 2022] DELETE /identity/v3/projects/0713040636b4408c95dcadbb9b1fe3cc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:27.151751 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.152265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.152360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.173887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:27.175133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:27.228183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:27.245758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1137/2313] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:21:27.253339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.253678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.253957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.275887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:27.279619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:27.290336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1177/2314] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:27.292443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.303419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783c583-8170-47e5-b683-58d927b70e77 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.309261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.310130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.310534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.310833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.311716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:21:27.312113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.313806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.327324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1138/2315] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:21:27.331631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.341566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33fa40-1e1c-4e77-94ad-60455fd885f0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.348144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.349183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.349483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.349760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.350497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.352495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.385821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1178/2316] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:21:27 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:27.391505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.410805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90514ba2-babf-4834-b727-c035f1a4e79f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.511379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.512015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.512275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.512548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.513259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.515583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.547312 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1139/2317] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:21:27 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:27.554174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.599221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31483c1-04d9-4c68-9dbb-74de0596029f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.609308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.610000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.610280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.610557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.611342 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.613024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.626062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1179/2318] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:21:27.631748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.643670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb624970-5cb6-445f-aa05-521be4cdfa4b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.649598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c078bd-e429-4053-8753-eb9a503f37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.650298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c078bd-e429-4053-8753-eb9a503f37f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.650577 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c078bd-e429-4053-8753-eb9a503f37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.650845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c078bd-e429-4053-8753-eb9a503f37f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.651585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c078bd-e429-4053-8753-eb9a503f37f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.653685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c078bd-e429-4053-8753-eb9a503f37f9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.666224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1140/2319] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:21:27.670607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.681627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad850076-fc44-4f9b-af2b-5a068b9cafdd admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.688286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.688286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.688286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.688286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] PATH_INFO: `/v3/projects/ffc7497a4d684bf29448b891b50dc7b8/users/e7e028cf9e914cd6b7b3991194339a1e/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.704764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc7497a4d684bf29448b891b50dc7b8, user_id=e7e028cf9e914cd6b7b3991194339a1e, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.707700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.724651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1180/2320] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:21:27 2022] PUT /identity/v3/projects/ffc7497a4d684bf29448b891b50dc7b8/users/e7e028cf9e914cd6b7b3991194339a1e/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:21:27.735616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.735781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.736062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.765289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] MFA Rules not processed for user `e7e028cf9e914cd6b7b3991194339a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:27.766472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:27.855741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1141/2321] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:27.867265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:27.869051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:27.879765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:27.949513 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6da572-c540-4eb0-9253-1ee6dad78ed8 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:27.955795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535245b-6b17-4182-87bb-d79e7da9fdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:27.956465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535245b-6b17-4182-87bb-d79e7da9fdab service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:27.956748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535245b-6b17-4182-87bb-d79e7da9fdab service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:27.957033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535245b-6b17-4182-87bb-d79e7da9fdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:27.965722 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535245b-6b17-4182-87bb-d79e7da9fdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:27.967439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535245b-6b17-4182-87bb-d79e7da9fdab service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:27.977360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1181/2322] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:35.540910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:35.595032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:35.611411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6150d7-6695-454c-b747-18c0696e72c6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:35.616488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:35.617414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:35.617696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:35.617972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] PATH_INFO: `/v3/users/e7e028cf9e914cd6b7b3991194339a1e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:35.619200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e028cf9e914cd6b7b3991194339a1e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:35.621445 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:35.674490 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e028cf9e914cd6b7b3991194339a1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:35.682337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e028cf9e914cd6b7b3991194339a1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:35.690398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e028cf9e914cd6b7b3991194339a1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:35.691126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e028cf9e914cd6b7b3991194339a1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:35.708337 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e028cf9e914cd6b7b3991194339a1e'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:35.714855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1142/2323] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:21:35 2022] DELETE /identity/v3/users/e7e028cf9e914cd6b7b3991194339a1e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:35.720405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:35.720913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:35.720913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:35.739781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:35.740911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:35.807126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1182/2324] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:35.817518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:35.819008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:35.880336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df55ec-d094-4035-9e55-2d3b7516a005 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:35.883801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a9188-1ada-42ee-b314-a500a2c5a400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:35.884457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9188-1ada-42ee-b314-a500a2c5a400 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:35.884733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9188-1ada-42ee-b314-a500a2c5a400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:35.885003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a9188-1ada-42ee-b314-a500a2c5a400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:35.895281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a9188-1ada-42ee-b314-a500a2c5a400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:35.896713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a9188-1ada-42ee-b314-a500a2c5a400 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:35.907615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1143/2325] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:36.215260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.216795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:36.232818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333a213-94bd-43ea-ae62-a9390817170f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.238600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.239561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.239960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.240300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] PATH_INFO: `/v3/projects/ffc7497a4d684bf29448b891b50dc7b8` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.241687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc7497a4d684bf29448b891b50dc7b8)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.243735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.294545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc7497a4d684bf29448b891b50dc7b8', 'request_id': 'req-14aa1c13-9489-4383-aa1d-cd323ada9ddd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:36.300205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc7497a4d684bf29448b891b50dc7b8', 'request_id': 'req-14aa1c13-9489-4383-aa1d-cd323ada9ddd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:36.306632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc7497a4d684bf29448b891b50dc7b8', 'request_id': 'req-14aa1c13-9489-4383-aa1d-cd323ada9ddd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:36.320657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] The token cache is being invalidate because project ffc7497a4d684bf29448b891b50dc7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:21:36.320943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:36.321586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-14aa1c13-9489-4383-aa1d-cd323ada9ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:36.323204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1183/2326] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:21:36 2022] DELETE /identity/v3/projects/ffc7497a4d684bf29448b891b50dc7b8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:36.329461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.329749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.330028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.348242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:36.349550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:36.412288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1144/2327] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:36.422515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.422808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.423091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.450177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:36.452950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:36.463063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1184/2328] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:36.467839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.480207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358ce2f-3810-4aef-9106-f248e352a328 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.486953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.487652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.487937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.488206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.488953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:21:36.489257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.490928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.498785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:36.507958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1145/2329] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:21:36.512645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.523121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1d9e9-2744-4bb6-976e-7a29472b9c7c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.529105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.529845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.530150 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.530431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.531288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.533153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.537829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:36.565267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1185/2330] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:21:36 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:36.569540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.582200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1dd9b-49b8-4b95-936f-07ca99abae6d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.651657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.652421 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.652726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.653424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.654231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.656926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.682303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1146/2331] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:21:36 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:36.686569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.698728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9e699-3e5f-4785-a149-bb1fa574120b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.705431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.706119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.706408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.706691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.707547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.709297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.721332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1186/2332] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:21:36.725316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.737202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048b82d-45f1-42ba-930f-393841582388 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.741928 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbe50-4fe6-4026-9b04-035160c1d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.742634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbe50-4fe6-4026-9b04-035160c1d61b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.742909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbe50-4fe6-4026-9b04-035160c1d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.743181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbe50-4fe6-4026-9b04-035160c1d61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.743914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbe50-4fe6-4026-9b04-035160c1d61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.745530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbe50-4fe6-4026-9b04-035160c1d61b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.756549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1147/2333] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:21:36.760830 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.773699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135f5fb-d47c-447d-a759-a3d627eff2aa admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.779068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.780114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.780664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.780664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] PATH_INFO: `/v3/projects/cb2d83e91f0f4e4b9c67d5437769894c/users/a30646bcf46e4a66955fff351a7eb6b9/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.799333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2d83e91f0f4e4b9c67d5437769894c, user_id=a30646bcf46e4a66955fff351a7eb6b9, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:36.802613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:36.818757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1187/2334] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:21:36 2022] PUT /identity/v3/projects/cb2d83e91f0f4e4b9c67d5437769894c/users/a30646bcf46e4a66955fff351a7eb6b9/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:36.824265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a828d-9165-4b8f-a636-70ff1afd7fcf None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.824565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a828d-9165-4b8f-a636-70ff1afd7fcf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.824847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a828d-9165-4b8f-a636-70ff1afd7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:36.843927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-753a828d-9165-4b8f-a636-70ff1afd7fcf None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:36.845155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-753a828d-9165-4b8f-a636-70ff1afd7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:36.910235 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1148/2335] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:36.920918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:36.923012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:36.989173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de6256-c71b-4563-bbd7-a17d20a0f186 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:36.994213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:36.995548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:36.995713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:36.995988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:37.008014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:37.009804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:37.036116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1188/2336] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:37.740790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:37.741370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:37.741370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:37.772789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] MFA Rules not processed for user `a30646bcf46e4a66955fff351a7eb6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:37.774239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:37.858061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1149/2337] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:21:37.864123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:37.879085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d00ed-0d60-4b5c-89a5-fa35ebb56a08 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:37.884574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:37.885534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:37.885914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:37.886260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:37.887121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:37.889180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:37.919729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1189/2338] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:21:37 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:37.923967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:37.936413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fc8a3-e303-4003-9840-2bb760609938 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:37.940734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:38.000859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:38.001579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:38.001873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:38.002127 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:38.002853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:38.004793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:38.028388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1150/2339] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:21:37 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:21:38.031050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:38.043274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03a2d7-5da4-4abd-a999-18698f424664 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:38.049588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:38.050285 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:38.050568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:38.050844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:38.051617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:38.053250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:38.065558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1190/2340] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:21:38.071596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:38.084345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7eb94-aacb-4e52-8a51-b75fae90ad3b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:38.090221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:38.091171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:38.091449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:38.091721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] PATH_INFO: `/v3/projects/5ea63a02b3744fde86d2150864e9baf1/users/a48acd7f49444669a504802df565e0f2/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:38.108377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea63a02b3744fde86d2150864e9baf1, user_id=a48acd7f49444669a504802df565e0f2, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:38.111256 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:38.126008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1151/2341] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:21:38 2022] PUT /identity/v3/projects/5ea63a02b3744fde86d2150864e9baf1/users/a48acd7f49444669a504802df565e0f2/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:38.130289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:38.141501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804176f-ef10-43b3-857e-b1528a13b127 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:38.204180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:38.205229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:38.205617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:38.205901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:38.206651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:38.208315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:38.222616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1191/2342] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:21:38.223891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:38.244819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196db1f-17ff-4df0-9399-92f8df940b64 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:38.250051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b134-ace2-4bbd-8584-72a7d6de11d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:38.251143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b134-ace2-4bbd-8584-72a7d6de11d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:38.251423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b134-ace2-4bbd-8584-72a7d6de11d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:38.251704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b134-ace2-4bbd-8584-72a7d6de11d7 admin admin] PATH_INFO: `/v3/projects/5ea63a02b3744fde86d2150864e9baf1/users/a48acd7f49444669a504802df565e0f2/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:38.253831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b134-ace2-4bbd-8584-72a7d6de11d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea63a02b3744fde86d2150864e9baf1, user_id=a48acd7f49444669a504802df565e0f2, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:38.256556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b134-ace2-4bbd-8584-72a7d6de11d7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:38.273768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1152/2343] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:21:38 2022] PUT /identity/v3/projects/5ea63a02b3744fde86d2150864e9baf1/users/a48acd7f49444669a504802df565e0f2/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:38.654849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:38.656965 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:38.689671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:38.773249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11089-7ea9-4d2f-909f-39c5606c3386 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:38.849568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:38.850247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:38.850529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:38.850873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:38.853000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:38.866587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:38.868227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:38.880554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1192/2344] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:39.018819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:39.020794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:39.021408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:39.068971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] MFA Rules not processed for user `a48acd7f49444669a504802df565e0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:39.070273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:39.180203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1153/2345] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:39.193801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:39.197406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:39.275871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9bc65-34a4-4daa-a3ac-0dca4509e469 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:39.280806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:39.281973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:39.283137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:39.283137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:39.346988 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:39.349348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:39.351533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:39.361609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1193/2346] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:40.784809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:40.786405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:40.799045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5d657-f256-43ee-8bed-d358a0aa6ff3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:40.802746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:40.803412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:40.803695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:40.803972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:40.814419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:40.815860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:40.826285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1154/2347] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:21:49.356862 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:50.821314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:54.490603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:54.565417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24996-fba1-493a-89a7-8602471ab5d7 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:54.571704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:54.572647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:54.572930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:54.573204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] PATH_INFO: `/v3/users/a30646bcf46e4a66955fff351a7eb6b9` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:54.574611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30646bcf46e4a66955fff351a7eb6b9)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:54.576554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:54.628224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30646bcf46e4a66955fff351a7eb6b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:54.636491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30646bcf46e4a66955fff351a7eb6b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:54.637252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30646bcf46e4a66955fff351a7eb6b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:54.650091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30646bcf46e4a66955fff351a7eb6b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:54.658458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30646bcf46e4a66955fff351a7eb6b9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:54.665543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1194/2348] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:21:54 2022] DELETE /identity/v3/users/a30646bcf46e4a66955fff351a7eb6b9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:54.869832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:54.881737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08770e-75fe-4b11-92a2-079675d2a8d9 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:54.944383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:54.945263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:54.945578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:54.945851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] PATH_INFO: `/v3/projects/cb2d83e91f0f4e4b9c67d5437769894c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:54.947118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2d83e91f0f4e4b9c67d5437769894c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:54.949026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.004482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2d83e91f0f4e4b9c67d5437769894c', 'request_id': 'req-76a54d08-c86f-4dc8-bb64-31da36a50a6f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.015246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2d83e91f0f4e4b9c67d5437769894c', 'request_id': 'req-76a54d08-c86f-4dc8-bb64-31da36a50a6f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.023359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2d83e91f0f4e4b9c67d5437769894c', 'request_id': 'req-76a54d08-c86f-4dc8-bb64-31da36a50a6f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.036326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] The token cache is being invalidate because project cb2d83e91f0f4e4b9c67d5437769894c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:21:55.036610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.037347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.038962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1155/2349] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:21:54 2022] DELETE /identity/v3/projects/cb2d83e91f0f4e4b9c67d5437769894c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:55.043723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.046010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:55.061812 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856be59a-3cda-4ac3-868a-20a06c67fc6e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.121769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.122663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.122946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.123227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] PATH_INFO: `/v3/users/a48acd7f49444669a504802df565e0f2` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.124529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48acd7f49444669a504802df565e0f2)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.126505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.148723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:55.177609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48acd7f49444669a504802df565e0f2'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.185570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48acd7f49444669a504802df565e0f2'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.186177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48acd7f49444669a504802df565e0f2'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.199820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48acd7f49444669a504802df565e0f2'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.206989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cf86f513-1f14-4433-8dc0-a2110e00471f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48acd7f49444669a504802df565e0f2'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.213749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1195/2350] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:21:55 2022] DELETE /identity/v3/users/a48acd7f49444669a504802df565e0f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:55.400177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.401684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:55.417063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a54d08-c86f-4dc8-bb64-31da36a50a6f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.491781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.492822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.493107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.493422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] PATH_INFO: `/v3/projects/5ea63a02b3744fde86d2150864e9baf1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.494636 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea63a02b3744fde86d2150864e9baf1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.496626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.535274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:55.549804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea63a02b3744fde86d2150864e9baf1', 'request_id': 'req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.561071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea63a02b3744fde86d2150864e9baf1', 'request_id': 'req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.568620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea63a02b3744fde86d2150864e9baf1', 'request_id': 'req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.580052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] The token cache is being invalidate because project 5ea63a02b3744fde86d2150864e9baf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:21:55.580338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.581569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a98fe1f6-d5c0-4a33-8122-b3ebdb85e054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:21:55.583504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1156/2351] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:21:55 2022] DELETE /identity/v3/projects/5ea63a02b3744fde86d2150864e9baf1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:55.588425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.588930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.589028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.608297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:55.609528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:55.674345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1196/2352] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:55.683120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.683409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.683686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.703394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:55.704627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:55.713899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1157/2353] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:55.718869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.734827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b009a-de33-41c9-82b5-d9395eaaa6b0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.741932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.742626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.742906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.743177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.743954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:21:55.744240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.745893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.758552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1197/2354] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:21:55.765123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.776807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc0968-9678-431a-ba43-25b1f8bc90be None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.783276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.783958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.784227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.784489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.785203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.787533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.827354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1158/2355] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:55.831809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.842383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a57e5a-2ee2-4274-88cf-36ee4af92624 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.902397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.903607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.903895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.904175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.904909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.906948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.928468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1198/2356] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:21:55 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:21:55.932600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.943469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca699345-9559-4b40-9693-1a33cbbb8252 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.948179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.948850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.949137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.949464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.950200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.951805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.962900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1159/2357] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:21:55.966923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:55.977364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174f44b-22de-4790-be5e-733a7277771f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:55.982801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5a797-c3aa-49a2-a5e9-a008a8aff5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:55.983486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5a797-c3aa-49a2-a5e9-a008a8aff5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:55.983770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5a797-c3aa-49a2-a5e9-a008a8aff5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:55.984045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5a797-c3aa-49a2-a5e9-a008a8aff5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:55.984826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5a797-c3aa-49a2-a5e9-a008a8aff5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:55.986636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5a797-c3aa-49a2-a5e9-a008a8aff5b1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:55.998125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1199/2358] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:21:56.002328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:56.012492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e516f0-628f-44e3-b0a3-42a47b47a9dd admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:56.017510 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:56.018408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:56.018692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:56.018998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] PATH_INFO: `/v3/projects/528e80d0acc849739050e7e5ab8a7285/users/86a83462a8cc45fca5539f0dfc66709c/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:56.034649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=528e80d0acc849739050e7e5ab8a7285, user_id=86a83462a8cc45fca5539f0dfc66709c, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:56.037349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:56.051563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1160/2359] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:21:56 2022] PUT /identity/v3/projects/528e80d0acc849739050e7e5ab8a7285/users/86a83462a8cc45fca5539f0dfc66709c/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:21:56.062170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:56.062466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:56.062747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:56.070686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:21:56.106493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] MFA Rules not processed for user `86a83462a8cc45fca5539f0dfc66709c`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:21:56.107735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:56.177659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1200/2360] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:21:56.188732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:21:56.191852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:21:56.249821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e90e9-41ba-4bd7-9a22-d0b3e14caf9d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:21:56.253792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c36997-919a-4cab-abfa-0f36dc0c58b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:21:56.254501 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c36997-919a-4cab-abfa-0f36dc0c58b3 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:21:56.254784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c36997-919a-4cab-abfa-0f36dc0c58b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:21:56.255057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c36997-919a-4cab-abfa-0f36dc0c58b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:21:56.263655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c36997-919a-4cab-abfa-0f36dc0c58b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:21:56.265099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c36997-919a-4cab-abfa-0f36dc0c58b3 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:21:56.274050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1161/2361] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:21:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:06.174419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=30 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:06.269971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=69,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:13.986295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:14.052137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5f20-5584-40b8-92ce-4e05eee1c2e2 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:14.057752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:14.058656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:14.058939 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:14.059214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] PATH_INFO: `/v3/users/86a83462a8cc45fca5539f0dfc66709c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:14.060581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a83462a8cc45fca5539f0dfc66709c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:14.062644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:14.112733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a83462a8cc45fca5539f0dfc66709c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:14.121588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a83462a8cc45fca5539f0dfc66709c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:14.122278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a83462a8cc45fca5539f0dfc66709c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:14.135185 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a83462a8cc45fca5539f0dfc66709c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:14.142903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a83462a8cc45fca5539f0dfc66709c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:14.148902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1201/2362] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:22:13 2022] DELETE /identity/v3/users/86a83462a8cc45fca5539f0dfc66709c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:14.153906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:14.154400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:14.154511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:14.173293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:14.174521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:14.239109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1162/2363] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:14.249578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:14.251408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:14.312994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103cf11-6808-4a80-99e4-12b316c3cf81 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:14.322613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1db31-0e3f-4775-a3ec-7ecc7cd5b2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:14.323297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1db31-0e3f-4775-a3ec-7ecc7cd5b2fc service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:14.323720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1db31-0e3f-4775-a3ec-7ecc7cd5b2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:14.323998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1db31-0e3f-4775-a3ec-7ecc7cd5b2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:14.335279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1db31-0e3f-4775-a3ec-7ecc7cd5b2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:14.336731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1db31-0e3f-4775-a3ec-7ecc7cd5b2fc service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:14.346936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1202/2364] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:14.925354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:14.929097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:14.958408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3150d51-74ca-475d-bcef-e5950ad05e65 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:14.972745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:14.974110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:14.974463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:14.975499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] PATH_INFO: `/v3/projects/528e80d0acc849739050e7e5ab8a7285` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:14.976479 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] RBAC: Authorizing `identity:delete_project(project_id=528e80d0acc849739050e7e5ab8a7285)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:14.978572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.049899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528e80d0acc849739050e7e5ab8a7285', 'request_id': 'req-d7762090-de57-43b3-be19-c2da774494db'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:15.059388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528e80d0acc849739050e7e5ab8a7285', 'request_id': 'req-d7762090-de57-43b3-be19-c2da774494db'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:15.066955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528e80d0acc849739050e7e5ab8a7285', 'request_id': 'req-d7762090-de57-43b3-be19-c2da774494db'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:15.080606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] The token cache is being invalidate because project 528e80d0acc849739050e7e5ab8a7285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:22:15.081007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:15.081809 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d7762090-de57-43b3-be19-c2da774494db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:15.085365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1163/2365] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:22:14 2022] DELETE /identity/v3/projects/528e80d0acc849739050e7e5ab8a7285 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:15.090146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd70b-8987-4b10-acdd-918bd8bac5f5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.090643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd70b-8987-4b10-acdd-918bd8bac5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.090807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dd70b-8987-4b10-acdd-918bd8bac5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.108728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b61dd70b-8987-4b10-acdd-918bd8bac5f5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:15.110437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b61dd70b-8987-4b10-acdd-918bd8bac5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:15.132662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:15.193771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1203/2366] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:15.202673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.203165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.203261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.212088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.212618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.212985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.224073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:15.225458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:15.233749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:15.235106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:15.236917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1164/2367] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:15.240945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.250925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1230fd-58c6-4d5e-8620-5475c921c98b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.255830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.256591 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.256933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.257236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.258126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:22:15.258441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.260045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.276289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1165/2368] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:22:15.278084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.290515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89307cab-8bbd-402b-a750-0a23ab3b201e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.295434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1204/2369] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:22:15.295639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.296136 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.296417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.296762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.297788 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.299648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.330341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1166/2370] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:15 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:22:15.335067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.348588 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.348762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b15307-d4d5-4c53-8836-1bcab7874955 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.350403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:15.401380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:15.409650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.410405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.410651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.410971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.411726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.413809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.430938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3088ea-03f2-45c2-83c8-96e719607a8f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.436240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1205/2371] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:15 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:22:15.437639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba28fab-17e7-426e-825d-eec0a9d7ee22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.439027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28fab-17e7-426e-825d-eec0a9d7ee22 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.439395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28fab-17e7-426e-825d-eec0a9d7ee22 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.439698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba28fab-17e7-426e-825d-eec0a9d7ee22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.440668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.450906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009808-7bb4-463a-b17a-5020b9c77793 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.457207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.458001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.458294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.458574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.459317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.460944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.481246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1206/2372] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:15.482742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.493953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08050-ded1-44e0-8037-df3a92c79315 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.498925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.499586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.499873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.500189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.500941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.502607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.504919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28fab-17e7-426e-825d-eec0a9d7ee22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.506681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba28fab-17e7-426e-825d-eec0a9d7ee22 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.516694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1207/2373] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:15.517291 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1167/2374] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:22:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:15.522713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.534821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf28301-3a84-4230-908d-56dabaad1d3f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.540648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.541663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.542000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.542334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] PATH_INFO: `/v3/projects/e8a9bcad2bef4d6cb5c88ff5d3444991/users/6c886addea8a42ed918f1769f4253030/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.572240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a9bcad2bef4d6cb5c88ff5d3444991, user_id=6c886addea8a42ed918f1769f4253030, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.575809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.595605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1208/2375] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:15 2022] PUT /identity/v3/projects/e8a9bcad2bef4d6cb5c88ff5d3444991/users/6c886addea8a42ed918f1769f4253030/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:15.606191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.606735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.607162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.640628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] MFA Rules not processed for user `6c886addea8a42ed918f1769f4253030`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:15.642145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:15.722860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1168/2376] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:15.730310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.732245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:15.748838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:15.802791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac5f53-f35a-4a2b-865a-8f82cf34694e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.806709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dc12b-8b29-4fd3-a7c7-d83b984937a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.807384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dc12b-8b29-4fd3-a7c7-d83b984937a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.807668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dc12b-8b29-4fd3-a7c7-d83b984937a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.807952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dc12b-8b29-4fd3-a7c7-d83b984937a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.817853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dc12b-8b29-4fd3-a7c7-d83b984937a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.819319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dc12b-8b29-4fd3-a7c7-d83b984937a1 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.831848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1209/2377] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:15.858343 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:15.934822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc056e-5b19-4ae6-8376-3afd62d7837d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:15.940129 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:15.941243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:15.941706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:15.942133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] PATH_INFO: `/v3/users/6c886addea8a42ed918f1769f4253030` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:15.943518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c886addea8a42ed918f1769f4253030)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:15.945689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:15.963748 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:16.008402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c886addea8a42ed918f1769f4253030'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.023017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c886addea8a42ed918f1769f4253030'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.043999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c886addea8a42ed918f1769f4253030'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.045180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c886addea8a42ed918f1769f4253030'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.072059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c886addea8a42ed918f1769f4253030'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.091520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.091520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.091520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.092247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1169/2378] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:22:15 2022] DELETE /identity/v3/users/6c886addea8a42ed918f1769f4253030 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:22:16.106234 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:16.107568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:16.202904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1210/2379] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:16.211100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:16.212924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:16.289909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198b673-a246-439b-9628-ffd88c70561b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:16.301267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6fb2f-837b-4316-b80c-5c73603b5e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:16.302224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6fb2f-837b-4316-b80c-5c73603b5e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.302609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6fb2f-837b-4316-b80c-5c73603b5e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.302979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6fb2f-837b-4316-b80c-5c73603b5e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.314122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6fb2f-837b-4316-b80c-5c73603b5e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:16.315754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6fb2f-837b-4316-b80c-5c73603b5e54 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:16.327058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1170/2380] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:16.641101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:16.642701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:16.659618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b99568-5ff8-4104-a228-2c7113e2f11a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:16.665020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:16.665960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.666247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.666533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] PATH_INFO: `/v3/projects/e8a9bcad2bef4d6cb5c88ff5d3444991` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.667770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a9bcad2bef4d6cb5c88ff5d3444991)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:16.669833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:16.724927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a9bcad2bef4d6cb5c88ff5d3444991', 'request_id': 'req-60101e45-8fbd-49c2-94bf-e57599e6e5c7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.732262 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a9bcad2bef4d6cb5c88ff5d3444991', 'request_id': 'req-60101e45-8fbd-49c2-94bf-e57599e6e5c7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.739597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a9bcad2bef4d6cb5c88ff5d3444991', 'request_id': 'req-60101e45-8fbd-49c2-94bf-e57599e6e5c7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.755327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] The token cache is being invalidate because project e8a9bcad2bef4d6cb5c88ff5d3444991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:22:16.755623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.756311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-60101e45-8fbd-49c2-94bf-e57599e6e5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:16.757943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1211/2381] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:22:16 2022] DELETE /identity/v3/projects/e8a9bcad2bef4d6cb5c88ff5d3444991 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:16.763212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.763516 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.763774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.785702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:16.786937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:16.876310 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1171/2382] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:16.884454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.884775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.885070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.905499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:16.907015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:16.920532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1212/2383] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:16.922816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:16.937930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20657a1a-6056-418c-9b4e-c54ed498b714 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:16.943962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:16.944658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.944945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.945228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.946060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:22:16.946340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:16.951113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:16.964727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1172/2384] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:22:16.969405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:16.979702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc863e59-cf68-4f38-8bec-f96299a99105 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:16.988604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:16.989355 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:16.989778 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:16.990000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:16.990736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:16.992833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.026532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1213/2385] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:16 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:17.031152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:17.044645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07083c-e1f1-4a77-8242-74389e674c4d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:17.068377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:17.136723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:17.137209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.137526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.137807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.138522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:17.140485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.173446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1173/2386] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:17 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:22:17.177981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:17.195303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce84af-9888-46af-9421-5a1855991051 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:17.204688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:17.205730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.206255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.206792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.208068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:17.211746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.215463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:17.238188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:17.238797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1214/2387] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:17.253743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239ca6a-7253-4375-b285-7fbdf9ee8de1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:17.259020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:17.259816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.260100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.260376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.261313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:17.262989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.278014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1174/2388] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:17.280055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:17.293815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5eef7-1b7e-4d1d-bf7b-5632a155cbb7 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:17.300664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fd28b-00ee-4252-a573-2ec348464a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:17.302792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd28b-00ee-4252-a573-2ec348464a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.303153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd28b-00ee-4252-a573-2ec348464a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.303782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd28b-00ee-4252-a573-2ec348464a72 admin admin] PATH_INFO: `/v3/projects/1bc7b00884114a089c6d2c785fc8e9ed/users/fb2ceaafe83f4d67ae9ea6492b21a850/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.306587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:17.309478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:17.329927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fd28b-00ee-4252-a573-2ec348464a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc7b00884114a089c6d2c785fc8e9ed, user_id=fb2ceaafe83f4d67ae9ea6492b21a850, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:17.330605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fd28b-00ee-4252-a573-2ec348464a72 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.348385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1215/2389] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:17 2022] PUT /identity/v3/projects/1bc7b00884114a089c6d2c785fc8e9ed/users/fb2ceaafe83f4d67ae9ea6492b21a850/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:17.353690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.354113 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.354510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.374509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:17.376142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:17.425399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb0c46-4bca-4589-862c-8fa0429edd2c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:17.457141 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1216/2390] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:17.470462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:17.472689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:17.529464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:17.529712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.530100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.530446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.532632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:17.549177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd79b8c-e09b-499b-b894-8e9a8383c04a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:17.561838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e83b9-d632-48b6-9e56-17f388bb2e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:17.562516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e83b9-d632-48b6-9e56-17f388bb2e48 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:17.562836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e83b9-d632-48b6-9e56-17f388bb2e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:17.563092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e83b9-d632-48b6-9e56-17f388bb2e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:17.582891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e83b9-d632-48b6-9e56-17f388bb2e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:17.585551 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e83b9-d632-48b6-9e56-17f388bb2e48 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.606463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1217/2391] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:17.610059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:17.665237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:17.666903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:17.682754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1175/2392] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:23.763534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:23.764145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:23.764145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:23.823470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] MFA Rules not processed for user `fb2ceaafe83f4d67ae9ea6492b21a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:23.825379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:23.945608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1218/2393] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:23.946364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:23.975920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81cbc78-f42e-496d-94c1-4b663c1b9e2b service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:23.986412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:23.987303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:23.987765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:23.988114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:23.988875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:23.991173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:24.036718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:24.041441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1176/2394] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:23 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:24.053029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7b305-a259-4f4c-b7cb-36a5713da8f6 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:24.060308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:24.149569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:24.150363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:24.150728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:24.151078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:24.151860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:24.154295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:24.194030 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1219/2395] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:24 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:24.195252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:24.213611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67639-11a8-4260-9a5d-fbe63c6f843f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:24.222363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:24.223341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:24.223722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:24.224045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:24.225909 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:24.232442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:24.260480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1177/2396] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:24.270669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:24.287664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b4ef3-66d7-459f-96f9-6c707616f86e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:24.293491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:24.294533 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:24.294916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:24.295315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] PATH_INFO: `/v3/projects/ecb23bdcedd840e3ac304264db268bb1/users/a2dfe915d4664630ab1d29d6eeee7e3b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:24.322007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb23bdcedd840e3ac304264db268bb1, user_id=a2dfe915d4664630ab1d29d6eeee7e3b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:24.324730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:24.351700 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1220/2397] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:24 2022] PUT /identity/v3/projects/ecb23bdcedd840e3ac304264db268bb1/users/a2dfe915d4664630ab1d29d6eeee7e3b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:24.356011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:24.370254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d85f7-0fbe-4f3f-9890-06324aa183e3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:24.499269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a44bbc-d45d-4aa0-bded-79e7347103a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:24.499898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44bbc-d45d-4aa0-bded-79e7347103a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:24.500314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44bbc-d45d-4aa0-bded-79e7347103a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:24.500587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44bbc-d45d-4aa0-bded-79e7347103a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:24.501378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a44bbc-d45d-4aa0-bded-79e7347103a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:24.503028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a44bbc-d45d-4aa0-bded-79e7347103a6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:24.531997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1178/2398] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:24.532233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:24.544337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c2d530-f34c-4a67-b685-443be6424d37 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:24.557729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:24.559195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:24.559710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:24.560249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] PATH_INFO: `/v3/projects/ecb23bdcedd840e3ac304264db268bb1/users/a2dfe915d4664630ab1d29d6eeee7e3b/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:24.562771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb23bdcedd840e3ac304264db268bb1, user_id=a2dfe915d4664630ab1d29d6eeee7e3b, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:24.566216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:24.579751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1221/2399] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:24 2022] PUT /identity/v3/projects/ecb23bdcedd840e3ac304264db268bb1/users/a2dfe915d4664630ab1d29d6eeee7e3b/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:32.961848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfba521-ae2f-492d-8969-de0df76a913b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:32.962307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfba521-ae2f-492d-8969-de0df76a913b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:32.962401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfba521-ae2f-492d-8969-de0df76a913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:33.006504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dcfba521-ae2f-492d-8969-de0df76a913b None None] MFA Rules not processed for user `a2dfe915d4664630ab1d29d6eeee7e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:33.010194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dcfba521-ae2f-492d-8969-de0df76a913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:33.103434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1179/2400] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:33.120607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:33.122598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:33.205042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54425a07-845e-4043-8026-4383eb2f5c17 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:33.211173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:33.211852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:33.212135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:33.212429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:33.275850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:33.278866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:33.280854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:33.292059 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1222/2401] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:34.935252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f1a5-c47b-45c7-b139-1b9458e656e0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:34.935891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f1a5-c47b-45c7-b139-1b9458e656e0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:34.935891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90f1a5-c47b-45c7-b139-1b9458e656e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:34.972895 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9e90f1a5-c47b-45c7-b139-1b9458e656e0 None None] MFA Rules not processed for user `fb2ceaafe83f4d67ae9ea6492b21a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:34.974356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9e90f1a5-c47b-45c7-b139-1b9458e656e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:34.989955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1180/2402] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:36.125118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:36.127872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:36.238973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2883c-fc4c-478c-9a3b-7b38f2e5e053 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:36.247259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:36.248277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:36.248751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:36.249204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:36.252731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:36.360098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:36.362802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace689b5-e09e-4f91-99de-1cb34e0a0e2a service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:36.381892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1223/2403] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:36.771057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957e63b-82d3-41b4-8c62-5388b864a9aa None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:36.771610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957e63b-82d3-41b4-8c62-5388b864a9aa None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:36.771610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957e63b-82d3-41b4-8c62-5388b864a9aa None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:36.773143 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1181/2404] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:22:36.780152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbe78c-a876-40a4-b7ea-71e6c2969b92 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:36.780438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbe78c-a876-40a4-b7ea-71e6c2969b92 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:36.781752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbe78c-a876-40a4-b7ea-71e6c2969b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:36.805894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-42bbe78c-a876-40a4-b7ea-71e6c2969b92 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:36.807446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-42bbe78c-a876-40a4-b7ea-71e6c2969b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:36.819541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1224/2405] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:22:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:36.833028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957e63b-82d3-41b4-8c62-5388b864a9aa None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:36.835681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3957e63b-82d3-41b4-8c62-5388b864a9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:36.869094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:36.985114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957e63b-82d3-41b4-8c62-5388b864a9aa None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:37.008190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39514c38-0696-49b3-8911-9be6121d2e37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:37.010470 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514c38-0696-49b3-8911-9be6121d2e37 service glance] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.011297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514c38-0696-49b3-8911-9be6121d2e37 service glance] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.012196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514c38-0696-49b3-8911-9be6121d2e37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.028376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39514c38-0696-49b3-8911-9be6121d2e37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:37.030454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39514c38-0696-49b3-8911-9be6121d2e37 service glance] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:37.064607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1182/2406] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:22:37.177491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e7374-8b01-4f20-b5b9-df49e5503b43 None None] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.178536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e7374-8b01-4f20-b5b9-df49e5503b43 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.179031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e7374-8b01-4f20-b5b9-df49e5503b43 None None] PATH_INFO: `/` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.181516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1225/2407] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:22:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:22:37.193092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec65c-f402-4d36-a730-370035ccde21 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.193658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec65c-f402-4d36-a730-370035ccde21 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.194094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec65c-f402-4d36-a730-370035ccde21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.235843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-702ec65c-f402-4d36-a730-370035ccde21 None None] MFA Rules not processed for user `7f079c8cd88047f6b563caff1dc5e52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:37.237168 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-702ec65c-f402-4d36-a730-370035ccde21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:37.254770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1183/2408] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:22:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:37.267440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e7374-8b01-4f20-b5b9-df49e5503b43 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:37.296371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e7374-8b01-4f20-b5b9-df49e5503b43 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:37.325958 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127310e-94e6-4c1e-b593-fbd55bb7071a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:37.326783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127310e-94e6-4c1e-b593-fbd55bb7071a service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.327293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127310e-94e6-4c1e-b593-fbd55bb7071a service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.327667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127310e-94e6-4c1e-b593-fbd55bb7071a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.346582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127310e-94e6-4c1e-b593-fbd55bb7071a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:37.348201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127310e-94e6-4c1e-b593-fbd55bb7071a service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:37.360011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1226/2409] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:37.494606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9c96-4e3c-4623-91d9-ce686684c92b None None] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.495902 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9c96-4e3c-4623-91d9-ce686684c92b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.496378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9c96-4e3c-4623-91d9-ce686684c92b None None] PATH_INFO: `/` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.498195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1184/2410] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jun 15 22:22:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 22:22:37.505590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290068f3-7a40-4d1d-9b0b-e23ed4c9a414 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.508366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290068f3-7a40-4d1d-9b0b-e23ed4c9a414 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.509179 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290068f3-7a40-4d1d-9b0b-e23ed4c9a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.534692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-290068f3-7a40-4d1d-9b0b-e23ed4c9a414 None None] MFA Rules not processed for user `37af776e1e594cf092bdcb7cf4e86379`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:37.536105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-290068f3-7a40-4d1d-9b0b-e23ed4c9a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:37.550933 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1227/2411] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jun 15 22:22:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:22:37.563130 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9c96-4e3c-4623-91d9-ce686684c92b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:37.579210 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9c96-4e3c-4623-91d9-ce686684c92b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:37.583850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:37.585050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:37.585601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:37.586100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:37.599294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:37.600778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:37.612557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1185/2412] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:40.518853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:40.519540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:40.519780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:40.558735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:40.560283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:40.649298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1228/2413] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:22:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:40.663615 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:40.665765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:40.772565 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af4a50-e719-4d28-ba10-a15554222ae8 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:40.790395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:40.790395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:40.790395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:40.790395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:40.804727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:40.805872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:40.840247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1186/2414] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:22:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:22:43.358598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:43.365690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:43.409213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc095-8ece-4984-b6d9-fd0938386925 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:43.418782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:43.420864 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:43.421676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:43.427843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] PATH_INFO: `/v3/users/728f1fbe76564467b378035d0d2d3be5` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:43.431023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=728f1fbe76564467b378035d0d2d3be5)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:43.434777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:43.474480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:43.542636 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728f1fbe76564467b378035d0d2d3be5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:43.556772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728f1fbe76564467b378035d0d2d3be5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:43.557642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728f1fbe76564467b378035d0d2d3be5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:43.577369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728f1fbe76564467b378035d0d2d3be5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:43.595712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-221756c5-1616-4aef-841a-3dbe2c0bf5ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728f1fbe76564467b378035d0d2d3be5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:43.608032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1229/2415] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:22:43 2022] DELETE /identity/v3/users/728f1fbe76564467b378035d0d2d3be5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:43.847278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:43.896669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6fc6-65d0-4c9b-a7fa-02e5bc1fc19a service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.008492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.010156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.010674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.011154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] PATH_INFO: `/v3/projects/e1c37e59766f45c3a46489befb803ff3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.012870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c37e59766f45c3a46489befb803ff3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.015185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.083662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:44.102399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c37e59766f45c3a46489befb803ff3', 'request_id': 'req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:44.116273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c37e59766f45c3a46489befb803ff3', 'request_id': 'req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:44.123896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c37e59766f45c3a46489befb803ff3', 'request_id': 'req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:44.164652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] The token cache is being invalidate because project e1c37e59766f45c3a46489befb803ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:22:44.166391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:44.167427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-4985c568-35cd-4ac1-8bd2-9845d79bcf1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:44.170796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1187/2416] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:22:43 2022] DELETE /identity/v3/projects/e1c37e59766f45c3a46489befb803ff3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:44.177558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.177987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.178373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.199367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:44.200648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:44.303523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1230/2417] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:44.305115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.305423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.305697 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.326415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:44.327830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:44.340296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1188/2418] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:22:44.341617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:44.353121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915df9-75b2-4eb9-becc-db1b98a92d99 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.358570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.359286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.360273 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.360803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.361359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:22:44.361782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.363504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.382702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1231/2419] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:22:44.385262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:44.399155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03730311-3ab7-43b0-af73-53f01d3ca74c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.404825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.405540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.405823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.406119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.407765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.415953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.470768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:44.481530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1189/2420] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:44 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:22:44.485605 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f34536-08e9-4122-ac17-698d02a4cb95 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.584339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.585189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.585641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.590425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.591581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.600240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.649629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1232/2421] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:44 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:44.654176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:44.666144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a528e-3da3-41d2-82cd-dad3b0d3fdcf admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.671025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.671868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.672153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.672437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.673452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.675253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.698365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1190/2422] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:44.706445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:44.721292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604286-4247-4ea9-8542-ca1a1028ae7b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.726110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28978948-4a78-471b-ae33-c1eae7154447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.726797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978948-4a78-471b-ae33-c1eae7154447 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.727108 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978948-4a78-471b-ae33-c1eae7154447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.727389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978948-4a78-471b-ae33-c1eae7154447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.728142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978948-4a78-471b-ae33-c1eae7154447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.729871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978948-4a78-471b-ae33-c1eae7154447 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.747953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1233/2423] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:44.752605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:44.768266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6dce7-30d2-45a0-8e2f-8e0ee76c598c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:44.780069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:44.781086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.781408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.781759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] PATH_INFO: `/v3/projects/ed4f9fb813cb4c6986063afb6342ba7d/users/52ebf8487dac4a079621deb74e8582b8/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.798211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4f9fb813cb4c6986063afb6342ba7d, user_id=52ebf8487dac4a079621deb74e8582b8, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:44.801054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:44.818726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1191/2424] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:44 2022] PUT /identity/v3/projects/ed4f9fb813cb4c6986063afb6342ba7d/users/52ebf8487dac4a079621deb74e8582b8/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:22:44.830418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:44.830634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:44.830934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:44.837249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:44.864768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] MFA Rules not processed for user `52ebf8487dac4a079621deb74e8582b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:44.866041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:44.958845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1234/2425] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:44.963952 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.053080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7badab-abc0-4a4a-a461-2d304f610415 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.059663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.060372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.060725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.061041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.061803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.064357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.105362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1192/2426] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:44 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:45.110529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.121827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e9365-41c4-404a-8a15-bfe03dbe32bc None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.191183 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.191943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.192231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.192507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.193251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.195814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.238929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.239290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1235/2427] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:45 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:45.253664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605da58-27e2-4db0-a42f-ef44f1300815 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.258681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.259363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.259644 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.259923 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.260771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.262307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.279482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1193/2428] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:45.284265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.297097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30f191-ba70-43e9-a3a9-02ecd9633c40 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.311349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.313554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.314919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.315568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] PATH_INFO: `/v3/projects/a90162a80b0a4c7eadd4b77903f81df5/users/490182da0c1e468f939923e8b94eebd7/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.338974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90162a80b0a4c7eadd4b77903f81df5, user_id=490182da0c1e468f939923e8b94eebd7, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.342664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.369487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1236/2429] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:45 2022] PUT /identity/v3/projects/a90162a80b0a4c7eadd4b77903f81df5/users/490182da0c1e468f939923e8b94eebd7/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:45.375618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.386907 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ab325-bd44-477e-93e6-3b9bf86ea1a5 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.451542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:45.521115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b4727-63d4-43e4-a1d4-9915a2dfa031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.522286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b4727-63d4-43e4-a1d4-9915a2dfa031 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.522622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b4727-63d4-43e4-a1d4-9915a2dfa031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.523115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b4727-63d4-43e4-a1d4-9915a2dfa031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.524015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b4727-63d4-43e4-a1d4-9915a2dfa031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.526482 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b4727-63d4-43e4-a1d4-9915a2dfa031 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.542532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1194/2430] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:45.543883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.559332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6051a-fd92-4acb-b0aa-7db9de7825c9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.573947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.575115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.575487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.575849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] PATH_INFO: `/v3/projects/a90162a80b0a4c7eadd4b77903f81df5/users/490182da0c1e468f939923e8b94eebd7/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.579397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90162a80b0a4c7eadd4b77903f81df5, user_id=490182da0c1e468f939923e8b94eebd7, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.583379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.607972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1237/2431] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:45 2022] PUT /identity/v3/projects/a90162a80b0a4c7eadd4b77903f81df5/users/490182da0c1e468f939923e8b94eebd7/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:45.618346 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.618698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.619042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.703189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] MFA Rules not processed for user `490182da0c1e468f939923e8b94eebd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:45.704967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:45.838839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1195/2432] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:45.851719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:45.853903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:45.917517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:45.953399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0b88-728e-4462-9f45-e566397f9f2c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:45.963131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:45.963994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:45.964278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:45.964555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:45.980066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:45.981820 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:45.993449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1238/2433] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:46.550791 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:46.628184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65dab1-9ba7-4944-a4f8-010905acfcd0 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:46.632807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:46.633858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:46.634138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:46.634416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] PATH_INFO: `/v3/users/52ebf8487dac4a079621deb74e8582b8` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:46.635651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ebf8487dac4a079621deb74e8582b8)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:46.637773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:46.704263 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ebf8487dac4a079621deb74e8582b8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:46.735541 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ebf8487dac4a079621deb74e8582b8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:46.736447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:46.755401 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ebf8487dac4a079621deb74e8582b8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:46.756260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ebf8487dac4a079621deb74e8582b8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:46.793380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-800a0f15-6fee-4b45-a298-88b9872aa72c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ebf8487dac4a079621deb74e8582b8'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:46.812835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:46.813571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1196/2434] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:22:46 2022] DELETE /identity/v3/users/52ebf8487dac4a079621deb74e8582b8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:22:46.815892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:46.819269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:46.819561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:46.819844 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:46.857785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:46.859878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:46.949699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4933d4-ed37-44c6-80f9-b172e1f3bed6 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:46.992084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1197/2435] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:47.002545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:47.004509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:47.022545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:47.023485 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:47.024026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:47.024547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:47.027520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:47.052097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:47.054165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:47.068157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1239/2436] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:47.148498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd461b-2b79-4e41-8127-318f4533ea68 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:47.156834 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:47.157140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:47.157526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:47.157870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:47.186056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:47.188174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:47.200447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1198/2437] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:47.751909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:47.753821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:47.786740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62da90-37ad-4c88-844e-91201227a478 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:47.799493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:47.800684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:47.801042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:47.801547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] PATH_INFO: `/v3/projects/ed4f9fb813cb4c6986063afb6342ba7d` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:47.802966 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4f9fb813cb4c6986063afb6342ba7d)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:47.805176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:47.914785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4f9fb813cb4c6986063afb6342ba7d', 'request_id': 'req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:47.928875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4f9fb813cb4c6986063afb6342ba7d', 'request_id': 'req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:47.938539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4f9fb813cb4c6986063afb6342ba7d', 'request_id': 'req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:47.977365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] The token cache is being invalidate because project ed4f9fb813cb4c6986063afb6342ba7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:22:47.977365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:47.994020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:47.996256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1240/2438] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:22:47 2022] DELETE /identity/v3/projects/ed4f9fb813cb4c6986063afb6342ba7d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:48.000926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:48.017631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68eabd-1862-4ffc-9705-32813887f92d service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:48.107730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:48.108694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:48.109018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:48.109430 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] PATH_INFO: `/v3/users/490182da0c1e468f939923e8b94eebd7` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:48.110840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490182da0c1e468f939923e8b94eebd7)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:48.112847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:48.137816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:48.182357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490182da0c1e468f939923e8b94eebd7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.194335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490182da0c1e468f939923e8b94eebd7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.211708 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490182da0c1e468f939923e8b94eebd7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.212535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490182da0c1e468f939923e8b94eebd7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.238058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-2c88344c-e654-4973-ba07-dbc76d8e75a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490182da0c1e468f939923e8b94eebd7'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.246721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1199/2439] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:22:47 2022] DELETE /identity/v3/users/490182da0c1e468f939923e8b94eebd7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:48.641389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:48.641389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:48.664884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725f5f2-ccf1-4b0d-b9a2-6080cfe0e62b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:48.744844 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:48.797661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:48.797661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:48.797661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:48.797661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] PATH_INFO: `/v3/projects/a90162a80b0a4c7eadd4b77903f81df5` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:48.798147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90162a80b0a4c7eadd4b77903f81df5)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:48.799723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:48.858100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90162a80b0a4c7eadd4b77903f81df5', 'request_id': 'req-80acbda8-bc58-4fca-a93b-c00024b5a2da'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.867271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90162a80b0a4c7eadd4b77903f81df5', 'request_id': 'req-80acbda8-bc58-4fca-a93b-c00024b5a2da'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.880616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90162a80b0a4c7eadd4b77903f81df5', 'request_id': 'req-80acbda8-bc58-4fca-a93b-c00024b5a2da'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.903235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] The token cache is being invalidate because project a90162a80b0a4c7eadd4b77903f81df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:22:48.903791 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.905405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-80acbda8-bc58-4fca-a93b-c00024b5a2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:48.912992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1241/2440] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:22:48 2022] DELETE /identity/v3/projects/a90162a80b0a4c7eadd4b77903f81df5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:48.916882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:48.917174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:48.917476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:48.961609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:48.963744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:49.069175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1200/2441] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:49.079517 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b173b-6835-4688-af38-f557a6306435 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.080160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b173b-6835-4688-af38-f557a6306435 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.080267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b173b-6835-4688-af38-f557a6306435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.131056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a48b173b-6835-4688-af38-f557a6306435 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:49.132570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a48b173b-6835-4688-af38-f557a6306435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:49.162669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1242/2442] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:49.163581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.176102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493be2f6-e11a-4868-996e-fca33f2832b9 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.206020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.206737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.207031 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.207311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.208139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:22:49.208458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.212882 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.253383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1201/2443] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:22:49.256809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b173b-6835-4688-af38-f557a6306435 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.275755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b173b-6835-4688-af38-f557a6306435 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.290826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.294056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.294863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.295766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.298397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.303448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.369378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1243/2444] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:49 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:49.375915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.390153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3705-8511-468a-810c-2e470abd7c18 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.498204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.499434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.500025 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.500994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.501984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.504199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.534227 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1202/2445] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:49 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:49.538025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.549745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e33102-4a5b-4fad-929d-6b9e181cea45 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.554905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.555678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.556001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.556439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.557245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.559561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.583529 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1244/2446] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:49.586345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.611725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f8fb-74a6-4199-b1b9-4e8aa5c9cc4f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.616992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d38ec-1766-4c43-8f2a-b9f75f1f7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.617733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d38ec-1766-4c43-8f2a-b9f75f1f7a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.618020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d38ec-1766-4c43-8f2a-b9f75f1f7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.618299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d38ec-1766-4c43-8f2a-b9f75f1f7a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.619043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d38ec-1766-4c43-8f2a-b9f75f1f7a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.620762 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d38ec-1766-4c43-8f2a-b9f75f1f7a43 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.630374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:49.638118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1203/2447] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:49.643138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.654293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeaecd-38fe-4499-ab06-6a1925226658 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.659766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.660676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.660956 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.661230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] PATH_INFO: `/v3/projects/0a2f7545c16a43329f6771dc280505b6/users/30300afcce7547ba8f86b988fdbed0c3/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.681523 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2f7545c16a43329f6771dc280505b6, user_id=30300afcce7547ba8f86b988fdbed0c3, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.685212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.706814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1245/2448] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:49 2022] PUT /identity/v3/projects/0a2f7545c16a43329f6771dc280505b6/users/30300afcce7547ba8f86b988fdbed0c3/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:49.717536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.718216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.718216 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.749471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] MFA Rules not processed for user `30300afcce7547ba8f86b988fdbed0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:49.751843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:49.828407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1204/2449] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:49.833490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.903394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:49.911265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf7972-9809-43dc-a040-e832d49563fa admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:49.920399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:49.921620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:49.922134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:49.922643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:49.923798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:49.925991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:49.965646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1246/2450] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:49 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:49.966906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:49.983442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182db7d6-3441-4f21-8e70-cc6cd8d77a2c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.061443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.062886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.063425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.063739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.064771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.066542 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.098373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1205/2451] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:49 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:50.102777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:50.115111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f2a55b-e2bd-4ccf-b77a-3018fb9a7169 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.121374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.122123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.122556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.122843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.123707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.126261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.139040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1247/2452] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:50.143212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:50.156223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236066a7-f1fe-45d3-b468-bcaf02e7f316 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.162062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.163262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.163693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.163903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] PATH_INFO: `/v3/projects/52bf235ce92041f9ad3e9b032dab60a3/users/4ab3aa92fc904b6bafb1e7b0b5f05dd0/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.184394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bf235ce92041f9ad3e9b032dab60a3, user_id=4ab3aa92fc904b6bafb1e7b0b5f05dd0, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.187600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.204709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1206/2453] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:50 2022] PUT /identity/v3/projects/52bf235ce92041f9ad3e9b032dab60a3/users/4ab3aa92fc904b6bafb1e7b0b5f05dd0/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:22:50.208515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:50.220969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2620267-262f-4643-ab83-9924c1f16f7e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.293062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03745b8-870c-4129-98c4-a659f990d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.293062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03745b8-870c-4129-98c4-a659f990d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.293062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03745b8-870c-4129-98c4-a659f990d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.293062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03745b8-870c-4129-98c4-a659f990d3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.293678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03745b8-870c-4129-98c4-a659f990d3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.294758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03745b8-870c-4129-98c4-a659f990d3d4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.307376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1248/2454] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:50.312202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:50.332924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ccf39-dc33-4e7f-ab4e-e28e98ff3712 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.341531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.343257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.344190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.344790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] PATH_INFO: `/v3/projects/52bf235ce92041f9ad3e9b032dab60a3/users/4ab3aa92fc904b6bafb1e7b0b5f05dd0/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.348635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bf235ce92041f9ad3e9b032dab60a3, user_id=4ab3aa92fc904b6bafb1e7b0b5f05dd0, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.353941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.374992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1207/2455] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:50 2022] PUT /identity/v3/projects/52bf235ce92041f9ad3e9b032dab60a3/users/4ab3aa92fc904b6bafb1e7b0b5f05dd0/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:50.396926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.397225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.397550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.427190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] MFA Rules not processed for user `4ab3aa92fc904b6bafb1e7b0b5f05dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:50.428457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:50.520898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1249/2456] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:50.533797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:50.535982 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:50.589509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:50.605865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bfa44-07b1-43ba-8ec8-47a3599308d2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.610165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.610840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.611125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.611407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.625843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.627453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.639474 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1208/2457] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:50.730201 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:50.745250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89995b1d-e186-4ad6-a454-dabde080a45b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:50.750671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:50.751708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:50.752175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:50.752833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:50.846387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:50.851407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:50.853519 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:50.867299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1250/2458] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:51.762309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:51.763892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:51.844016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae8dc-7393-4910-8aae-e37b76ff818e service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:51.849065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:51.849996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:51.850186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:51.850454 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] PATH_INFO: `/v3/users/c10fe54c24554b4db6783014a85cfa72` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:51.851669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10fe54c24554b4db6783014a85cfa72)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:51.853643 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:51.906904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10fe54c24554b4db6783014a85cfa72'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:51.915686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10fe54c24554b4db6783014a85cfa72'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:51.924373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10fe54c24554b4db6783014a85cfa72'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:51.925131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10fe54c24554b4db6783014a85cfa72'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:51.939784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3cc2b946-121c-4c18-b443-fab9d3089f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10fe54c24554b4db6783014a85cfa72'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:51.946804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1209/2459] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:22:51 2022] DELETE /identity/v3/users/c10fe54c24554b4db6783014a85cfa72 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:52.158925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.181015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897126e5-a6d0-46d8-901a-0d894d00cf80 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.284963 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.286329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.286925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.287458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] PATH_INFO: `/v3/projects/e2dec64625f54967a0032506f799ed6a` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.289148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dec64625f54967a0032506f799ed6a)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.291487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.356426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dec64625f54967a0032506f799ed6a', 'request_id': 'req-98319e2f-8d80-4866-befd-1b03c1e14739'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:52.363843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dec64625f54967a0032506f799ed6a', 'request_id': 'req-98319e2f-8d80-4866-befd-1b03c1e14739'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:52.372708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dec64625f54967a0032506f799ed6a', 'request_id': 'req-98319e2f-8d80-4866-befd-1b03c1e14739'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:52.392406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] The token cache is being invalidate because project e2dec64625f54967a0032506f799ed6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:22:52.392406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:52.393252 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-98319e2f-8d80-4866-befd-1b03c1e14739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:22:52.398750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1251/2460] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:22:52 2022] DELETE /identity/v3/projects/e2dec64625f54967a0032506f799ed6a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:52.400476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.401491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.403196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.430840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:52.432116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:52.536699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1210/2461] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:52.545867 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.546190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.546920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.590856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:52.593666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:52.618380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.618886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1252/2462] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:52.626514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:52.630690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6a23c-64e9-407f-92a4-934a6267f01c None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.637460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.638141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.638472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.638741 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.639473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:22:52.639782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.642932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.657370 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1211/2463] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:22:52.662631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.676983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858eb921-c78d-40a5-82c2-b1207201df00 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.684626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.685878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.686380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.686886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.688788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.692271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.734996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1253/2464] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:52 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:52.736437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.747413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd925c1b-ac2f-477e-bcb2-dbb111684698 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.809145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.809873 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.810159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.810502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.811177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.813233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.838102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1212/2465] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:52 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:52.839694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.850414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f3ccb-2fed-4f74-a016-ed1244180e10 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.856777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.857501 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.857782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.858064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.858874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.860826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.872176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1254/2466] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:52.877188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.889181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27f3d-a44c-4d3c-b04d-f576ab23c8df admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.894805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66bc1-f63a-4a02-a230-1a3c7fa55514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.895582 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66bc1-f63a-4a02-a230-1a3c7fa55514 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.895876 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66bc1-f63a-4a02-a230-1a3c7fa55514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.896150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66bc1-f63a-4a02-a230-1a3c7fa55514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.896885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66bc1-f63a-4a02-a230-1a3c7fa55514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.898518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66bc1-f63a-4a02-a230-1a3c7fa55514 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.910267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1213/2467] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:22:52.915974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:52.926948 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bc9c5-662e-4844-932e-9d8d5d495428 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:52.931702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:52.932544 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.932825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.933097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] PATH_INFO: `/v3/projects/dfe345b268b64c5797e5a85d81b7d6f9/users/6ca4b2c5a9044a9d890e4c66642a8e19/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:52.957934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe345b268b64c5797e5a85d81b7d6f9, user_id=6ca4b2c5a9044a9d890e4c66642a8e19, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:52.961709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:52.985040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1255/2468] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:52 2022] PUT /identity/v3/projects/dfe345b268b64c5797e5a85d81b7d6f9/users/6ca4b2c5a9044a9d890e4c66642a8e19/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:52.995808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:52.996341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:52.996730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.032183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] MFA Rules not processed for user `6ca4b2c5a9044a9d890e4c66642a8e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:53.033975 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:53.116078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1214/2469] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:22:53.120687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.145089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:53.205914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192611b-ed8b-4357-a8bb-05b6e8aaac83 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.211452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.212161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.212401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.212839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.213725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.215805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.261617 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1256/2470] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:22:53 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:22:53.262846 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.275771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd039-e428-43ea-93e6-76312c2b8d5b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.343010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.343772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.344052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.344328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.345199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.347181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.354377 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:53.377417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1215/2471] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:22:53 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:22:53.378465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.391048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9073e20-86c5-46e2-8eda-f4f310b08aa6 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.396794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.397557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.397843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.398121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.401152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.401152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.414240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1257/2472] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:53.419190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.429622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ab754-184e-4ed3-9841-8662e4bc1258 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.435276 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.436506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.440236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.440593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] PATH_INFO: `/v3/projects/9dc27cf6f54a4d02bfdf2d2e91c735c7/users/9cf05fe0b9634286a2e00a98f6a794fb/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.459889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc27cf6f54a4d02bfdf2d2e91c735c7, user_id=9cf05fe0b9634286a2e00a98f6a794fb, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.462816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.481775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1216/2473] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:53 2022] PUT /identity/v3/projects/9dc27cf6f54a4d02bfdf2d2e91c735c7/users/9cf05fe0b9634286a2e00a98f6a794fb/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:22:53.486522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.497460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b9f71-601a-41f3-a120-d84d27c50257 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.564788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b1964-8de7-4794-9cf3-6052eaa32487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.565476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b1964-8de7-4794-9cf3-6052eaa32487 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.565766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b1964-8de7-4794-9cf3-6052eaa32487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.566043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b1964-8de7-4794-9cf3-6052eaa32487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.566922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b1964-8de7-4794-9cf3-6052eaa32487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.568577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b1964-8de7-4794-9cf3-6052eaa32487 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.580635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1258/2474] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:22:53.584727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.596711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb1004-a18f-45d8-9c16-7654493e9602 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.603295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.604678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.604678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.604933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] PATH_INFO: `/v3/projects/9dc27cf6f54a4d02bfdf2d2e91c735c7/users/9cf05fe0b9634286a2e00a98f6a794fb/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.607803 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc27cf6f54a4d02bfdf2d2e91c735c7, user_id=9cf05fe0b9634286a2e00a98f6a794fb, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.610166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.634145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1217/2475] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:22:53 2022] PUT /identity/v3/projects/9dc27cf6f54a4d02bfdf2d2e91c735c7/users/9cf05fe0b9634286a2e00a98f6a794fb/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:22:53.635705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.636029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.636310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.671630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] MFA Rules not processed for user `9cf05fe0b9634286a2e00a98f6a794fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:22:53.672912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:53.764210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1259/2476] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:22:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:22:53.779376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.781723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:22:53.846085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0640c03-d10f-4340-8b63-b3ed9976423c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.849814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92747eb9-bfb6-448d-a1f6-f4e6660426e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.850475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92747eb9-bfb6-448d-a1f6-f4e6660426e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.850771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92747eb9-bfb6-448d-a1f6-f4e6660426e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.851051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92747eb9-bfb6-448d-a1f6-f4e6660426e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.860943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92747eb9-bfb6-448d-a1f6-f4e6660426e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:53.862428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92747eb9-bfb6-448d-a1f6-f4e6660426e0 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:53.873333 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1218/2477] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:22:53.946919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:22:53.957264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1f49-f01f-46ea-bb02-20f9a8052b9d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:22:53.961979 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:22:53.962634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:22:53.962987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:22:53.963255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:22:53.973571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:22:54.025080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:22:54.026602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:22:54.039091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1260/2478] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:22:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:00.949376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:00.949921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:00.950066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:00.971439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:00.972665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:01.044018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1219/2479] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 15 22:23:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:01.056717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:01.058376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:01.140317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95a47f-d342-4280-8234-05c1acab5673 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:01.146630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d7c77-d04f-4bb6-a272-cd7d6521186f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:01.147291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7c77-d04f-4bb6-a272-cd7d6521186f service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:01.147577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7c77-d04f-4bb6-a272-cd7d6521186f service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:01.147851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d7c77-d04f-4bb6-a272-cd7d6521186f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:01.157426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7c77-d04f-4bb6-a272-cd7d6521186f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:01.160641 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d7c77-d04f-4bb6-a272-cd7d6521186f service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:01.169407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1261/2480] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:23:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:23:03.967669 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:03.969209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.037851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbe902-ab90-4ee0-873f-a12e16251288 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:04.042867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:04.043753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.044030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.044300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] PATH_INFO: `/v3/users/30300afcce7547ba8f86b988fdbed0c3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.045560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30300afcce7547ba8f86b988fdbed0c3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:04.047494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:04.049156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:04.099838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30300afcce7547ba8f86b988fdbed0c3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.107558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30300afcce7547ba8f86b988fdbed0c3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.115917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30300afcce7547ba8f86b988fdbed0c3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.116620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30300afcce7547ba8f86b988fdbed0c3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.132372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30300afcce7547ba8f86b988fdbed0c3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.139215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1220/2481] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:03 2022] DELETE /identity/v3/users/30300afcce7547ba8f86b988fdbed0c3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:04.143985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.144481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.144481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.163000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:04.164258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.244796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1262/2482] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:04.255483 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:04.257138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.280943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:04.282440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.294393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5512b-5262-41e9-ba7d-a6c50d42e2c8 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:04.299299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:04.300231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.300516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.300795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] PATH_INFO: `/v3/users/6ca4b2c5a9044a9d890e4c66642a8e19` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.302046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca4b2c5a9044a9d890e4c66642a8e19)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:04.304031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:04.320808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2db564-0ec2-434e-b6e7-88a26deb0751 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:04.324675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20b541-f58f-440b-8be5-2d2d503ed1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:04.325341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b541-f58f-440b-8be5-2d2d503ed1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.325637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b541-f58f-440b-8be5-2d2d503ed1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.325910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20b541-f58f-440b-8be5-2d2d503ed1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.336067 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b541-f58f-440b-8be5-2d2d503ed1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:04.337957 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20b541-f58f-440b-8be5-2d2d503ed1c2 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:04.345877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:04.348380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1221/2483] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:04.356648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca4b2c5a9044a9d890e4c66642a8e19'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.366720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca4b2c5a9044a9d890e4c66642a8e19'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.367450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca4b2c5a9044a9d890e4c66642a8e19'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.380675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca4b2c5a9044a9d890e4c66642a8e19'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.387738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca4b2c5a9044a9d890e4c66642a8e19'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.394445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1263/2484] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:04 2022] DELETE /identity/v3/users/6ca4b2c5a9044a9d890e4c66642a8e19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:04.399372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.399696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.400022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.419200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:04.420593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.489003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1222/2485] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:04.499041 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:04.500849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.575899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c746ef-c84f-4253-8e15-9db3c836e9ce admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:04.580585 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:04.581350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.581754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.582104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.592915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:04.594438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:04.604976 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1264/2486] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:04.675329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:04.676990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.690073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f72be-b0ee-4740-a13f-71eda27c06e7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:04.695785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:04.696894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.697218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.697545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] PATH_INFO: `/v3/projects/0a2f7545c16a43329f6771dc280505b6` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.698815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2f7545c16a43329f6771dc280505b6)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:04.700755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:04.725906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:04.772178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2f7545c16a43329f6771dc280505b6', 'request_id': 'req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.780946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2f7545c16a43329f6771dc280505b6', 'request_id': 'req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.787511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2f7545c16a43329f6771dc280505b6', 'request_id': 'req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.799338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] The token cache is being invalidate because project 0a2f7545c16a43329f6771dc280505b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:04.799618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.800315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.802277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1223/2487] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:04 2022] DELETE /identity/v3/projects/0a2f7545c16a43329f6771dc280505b6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:04.806374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:04.816816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f8bdb-68b0-4f38-98e6-c65c3cbfa642 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:04.882361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:04.883336 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:04.883612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:04.883892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] PATH_INFO: `/v3/users/4ab3aa92fc904b6bafb1e7b0b5f05dd0` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:04.885139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab3aa92fc904b6bafb1e7b0b5f05dd0)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:04.887122 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:04.952165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab3aa92fc904b6bafb1e7b0b5f05dd0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.961192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:04.963277 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:04.967284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab3aa92fc904b6bafb1e7b0b5f05dd0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.968322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab3aa92fc904b6bafb1e7b0b5f05dd0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.972060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:04.988333 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab3aa92fc904b6bafb1e7b0b5f05dd0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:04.994022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ac6f0-d130-4a07-b35c-91fe9b7b0567 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.000668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab3aa92fc904b6bafb1e7b0b5f05dd0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.000891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.001848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.002124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.003109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] PATH_INFO: `/v3/projects/dfe345b268b64c5797e5a85d81b7d6f9` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.004569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe345b268b64c5797e5a85d81b7d6f9)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.006978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.012000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1265/2488] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:04 2022] DELETE /identity/v3/users/4ab3aa92fc904b6bafb1e7b0b5f05dd0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:05.069625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe345b268b64c5797e5a85d81b7d6f9', 'request_id': 'req-fb4959d7-7999-4f00-9525-893128c7d062'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.083848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe345b268b64c5797e5a85d81b7d6f9', 'request_id': 'req-fb4959d7-7999-4f00-9525-893128c7d062'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.094757 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe345b268b64c5797e5a85d81b7d6f9', 'request_id': 'req-fb4959d7-7999-4f00-9525-893128c7d062'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.109784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] The token cache is being invalidate because project dfe345b268b64c5797e5a85d81b7d6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:05.110077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.110754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.116555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.118095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.120083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1224/2489] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:04 2022] DELETE /identity/v3/projects/dfe345b268b64c5797e5a85d81b7d6f9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:05.190337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76f084-e01b-449b-bdfb-60b65df9d553 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.258828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.259730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.260013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.260291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] PATH_INFO: `/v3/users/9cf05fe0b9634286a2e00a98f6a794fb` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.261554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf05fe0b9634286a2e00a98f6a794fb)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.263516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.311688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.313407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.321667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf05fe0b9634286a2e00a98f6a794fb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.328626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4959d7-7999-4f00-9525-893128c7d062 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.332751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf05fe0b9634286a2e00a98f6a794fb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.333497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf05fe0b9634286a2e00a98f6a794fb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.334986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.336220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.336829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.337269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] PATH_INFO: `/v3/projects/52bf235ce92041f9ad3e9b032dab60a3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.338936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bf235ce92041f9ad3e9b032dab60a3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.341360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.347687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf05fe0b9634286a2e00a98f6a794fb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.354475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a26db7-d5a0-4ba2-a793-d223061e7c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf05fe0b9634286a2e00a98f6a794fb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.357279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:05.362242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1266/2490] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:05 2022] DELETE /identity/v3/users/9cf05fe0b9634286a2e00a98f6a794fb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:05.399980 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bf235ce92041f9ad3e9b032dab60a3', 'request_id': 'req-cbb2cbc4-a58c-46ff-a871-821e21879b41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.410002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bf235ce92041f9ad3e9b032dab60a3', 'request_id': 'req-cbb2cbc4-a58c-46ff-a871-821e21879b41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.416868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bf235ce92041f9ad3e9b032dab60a3', 'request_id': 'req-cbb2cbc4-a58c-46ff-a871-821e21879b41'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.433009 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] The token cache is being invalidate because project 52bf235ce92041f9ad3e9b032dab60a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:05.433280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.434201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-cbb2cbc4-a58c-46ff-a871-821e21879b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.436489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1225/2491] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:05 2022] DELETE /identity/v3/projects/52bf235ce92041f9ad3e9b032dab60a3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:05.443413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.443858 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.444278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.466873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:05.468126 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.542801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1267/2492] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:05.545960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.546246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.547088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.566983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:05.568219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.577557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1226/2493] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:05.582102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.592472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8803b48-379a-4770-a09a-c621abfbf402 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.598475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.599158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.599442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.599717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.600451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:05.600788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.602443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.614666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1268/2494] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:05.619173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.624899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:05.629494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516829cf-7149-4c0e-9d74-dc44d80d2581 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.636466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.637449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.637771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.638054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.638774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.641117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.667466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.669278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.670352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1227/2495] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:05.675307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.686166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125ba4d-372a-49b3-97e1-aaed849c353b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.742713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d774c-bdb1-4c13-8dfb-79ddc15f4d46 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.746278 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.747162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.747439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.747552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.747712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] PATH_INFO: `/v3/projects/9dc27cf6f54a4d02bfdf2d2e91c735c7` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.748266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.748480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.748758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.748936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc27cf6f54a4d02bfdf2d2e91c735c7)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.749497 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.750904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.751423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.777075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1228/2496] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:05.781165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.791624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bec9c6-efa4-429a-8019-fa4a32a1dc2c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.802914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc27cf6f54a4d02bfdf2d2e91c735c7', 'request_id': 'req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.808414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc27cf6f54a4d02bfdf2d2e91c735c7', 'request_id': 'req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.815496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc27cf6f54a4d02bfdf2d2e91c735c7', 'request_id': 'req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.830323 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] The token cache is being invalidate because project 9dc27cf6f54a4d02bfdf2d2e91c735c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:05.830699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.831269 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0cff37ff-7f11-4d33-bd14-3e703dbd68b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:05.832951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1269/2497] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:05 2022] DELETE /identity/v3/projects/9dc27cf6f54a4d02bfdf2d2e91c735c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:05.837769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.838061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.838340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.853356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704b9ce-6bba-4a15-81ab-6a8123af707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.854027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704b9ce-6bba-4a15-81ab-6a8123af707b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.854441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704b9ce-6bba-4a15-81ab-6a8123af707b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.854725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704b9ce-6bba-4a15-81ab-6a8123af707b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.855473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704b9ce-6bba-4a15-81ab-6a8123af707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.856744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:05.857069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7704b9ce-6bba-4a15-81ab-6a8123af707b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.857992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.866236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1270/2498] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:05.867562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1229/2499] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:05.871404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.872840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.874072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.874357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.874659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.885218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c9d5-924f-4681-ba5b-c28440a78fbe None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.890157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.890883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.891171 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.891447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.892193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.893951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:05.894180 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.895134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:05.899801 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:05.904649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1230/2500] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:05.909365 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1271/2501] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:05.909695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.912971 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.920180 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288abdd-3d22-4291-9bbc-dbad7ca34a48 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.924217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850981d-f582-42c3-ae48-ed7444013a22 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.925209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.925906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.926181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.926451 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.927175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:05.927478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.929160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.929675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64f1f-81a8-4837-81f0-5ab1d3714748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.930575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64f1f-81a8-4837-81f0-5ab1d3714748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.930887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64f1f-81a8-4837-81f0-5ab1d3714748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.931176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64f1f-81a8-4837-81f0-5ab1d3714748 admin admin] PATH_INFO: `/v3/projects/3b2852d391b34feb81a8036549a1a816/users/1d64897836b1443b80ab646205795eaa/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.945206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1231/2502] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:23:05.946112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:05.947930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64f1f-81a8-4837-81f0-5ab1d3714748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2852d391b34feb81a8036549a1a816, user_id=1d64897836b1443b80ab646205795eaa, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.950694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d64f1f-81a8-4837-81f0-5ab1d3714748 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.957011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff53f5-29ec-4184-98ce-d36519539109 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:05.962673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:05.963335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.963609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.963881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.964575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:05.966600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:05.966750 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1272/2503] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:05 2022] PUT /identity/v3/projects/3b2852d391b34feb81a8036549a1a816/users/1d64897836b1443b80ab646205795eaa/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:05.977354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:05.977730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:05.978006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:05.995500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1232/2504] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:05.999647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.006237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] MFA Rules not processed for user `1d64897836b1443b80ab646205795eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:06.007488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:06.031671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:06.066959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d33327-014d-455e-b205-e847888f9650 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.071696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.072381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.072670 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.072947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.073679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.074066 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1273/2505] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:06.075625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.078668 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.090845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f0940-e2fd-43a1-b06f-364869885a43 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.096047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.096871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.097159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.097470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.098186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1233/2506] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:05 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:06.098327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.100229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.102264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.113847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd41a5f-44f8-48ef-abff-f4c439804f32 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.118815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.119498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.119783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.120063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.120798 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.122549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.128140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1274/2507] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:06.132007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.138027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1234/2508] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:06.140417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.152887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5294-116b-4097-a82e-bafcbbc574a1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.202245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4a4e6-f283-4be2-a397-35fcfdec2fe1 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.209213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.209942 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.210251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.210508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.211208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.213198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.233271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.234206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.234637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.234979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.235950 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.238574 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.245562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1275/2509] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:06.249826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.250309 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1235/2510] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:06.254099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.264205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07ef81-ca95-406f-924a-b319c6863798 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.265543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ec40a-020b-42e9-bbf4-6e9fccf93b58 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.269729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9ed09-764d-4c03-9443-d8c59d89e936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.270686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ed09-764d-4c03-9443-d8c59d89e936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.271011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ed09-764d-4c03-9443-d8c59d89e936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.271347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9ed09-764d-4c03-9443-d8c59d89e936 admin admin] PATH_INFO: `/v3/projects/294b7c7fd12349fa8f8863e8b0e87e03/users/885a2341bf8d4215a76aa487cb14c575/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.271855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.272733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.273352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.273470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.274283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.276005 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.289209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ed09-764d-4c03-9443-d8c59d89e936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294b7c7fd12349fa8f8863e8b0e87e03, user_id=885a2341bf8d4215a76aa487cb14c575, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.291868 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9ed09-764d-4c03-9443-d8c59d89e936 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.296315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1276/2511] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:06.301835 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.308023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1236/2512] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:06 2022] PUT /identity/v3/projects/294b7c7fd12349fa8f8863e8b0e87e03/users/885a2341bf8d4215a76aa487cb14c575/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:06.311997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a314a-5b39-4fa5-8d71-b6211a619a72 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.319535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.319830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.320108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.332369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:06.346765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] MFA Rules not processed for user `885a2341bf8d4215a76aa487cb14c575`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:06.348092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:06.371918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.372817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.373096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.373410 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] PATH_INFO: `/v3/projects/0110e9aa178b4bf19e76f6073748e39a/users/dd7fa3430e2b4c7cbdbff0fdd0e31cf5/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.388811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0110e9aa178b4bf19e76f6073748e39a, user_id=dd7fa3430e2b4c7cbdbff0fdd0e31cf5, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.391497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.409543 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1277/2513] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:06 2022] PUT /identity/v3/projects/0110e9aa178b4bf19e76f6073748e39a/users/dd7fa3430e2b4c7cbdbff0fdd0e31cf5/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:06.413645 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.415480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1237/2514] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:06.419725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.431082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f89b-6394-4be6-92a3-25dd3d2b2c8e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.434934 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:06.491903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d9be7-db78-44bd-887a-3247070cc7fb admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.492983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.494068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.494473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.494784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.495690 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.498646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.499062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.500144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.500324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.500698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.501788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.503512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.513901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1278/2515] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:06.518017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.529225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620628b5-7eb0-4e7b-af55-38aba28c0597 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.535412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1238/2516] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:06.536642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.537340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed3a62-8ed9-41b7-a85f-5f5d4be13094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.538289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3a62-8ed9-41b7-a85f-5f5d4be13094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.538569 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3a62-8ed9-41b7-a85f-5f5d4be13094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.538839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed3a62-8ed9-41b7-a85f-5f5d4be13094 admin admin] PATH_INFO: `/v3/projects/0110e9aa178b4bf19e76f6073748e39a/users/dd7fa3430e2b4c7cbdbff0fdd0e31cf5/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.540751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed3a62-8ed9-41b7-a85f-5f5d4be13094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0110e9aa178b4bf19e76f6073748e39a, user_id=dd7fa3430e2b4c7cbdbff0fdd0e31cf5, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.543512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed3a62-8ed9-41b7-a85f-5f5d4be13094 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.554274 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1279/2517] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:06 2022] PUT /identity/v3/projects/0110e9aa178b4bf19e76f6073748e39a/users/dd7fa3430e2b4c7cbdbff0fdd0e31cf5/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:06.564573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.564952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.565235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.592082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] MFA Rules not processed for user `dd7fa3430e2b4c7cbdbff0fdd0e31cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:06.593434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:06.602115 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce61bb-076b-4bc1-a372-65f69520d2e3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.660091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.661030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.661030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.661311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.662906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.664623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1280/2518] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:06.669224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.676021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.678049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:06.695010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1239/2519] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:06.695217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:06.696646 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.708308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27183231-3847-4a0d-b07e-d18789cdf9bf admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.713268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.713976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.714258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.714534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.715270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.716887 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.728526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1240/2520] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:06.733060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.739372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5ace-4f00-4a7f-ace3-a5ccd1d3a7fd None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.743395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.743578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac46f2e-0100-4d94-9788-12a6b814c990 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.744040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.744321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.744587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.748525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.749533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.749813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.750089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] PATH_INFO: `/v3/projects/7125bcd9638045f69426c6f9cde9b589/users/8863c38cb1e84a28b25b60f1c21960d5/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.755000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.756464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.766458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1281/2521] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:06.766607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7125bcd9638045f69426c6f9cde9b589, user_id=8863c38cb1e84a28b25b60f1c21960d5, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.769258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.771583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:06.788073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1241/2522] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:06 2022] PUT /identity/v3/projects/7125bcd9638045f69426c6f9cde9b589/users/8863c38cb1e84a28b25b60f1c21960d5/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:06.793618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.809602 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45b7f6-2e4d-4315-bdbf-a5c2ae552bf7 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.853302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.873919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.874599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.874876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.875149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.875879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.877811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.888219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1282/2523] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:06.892493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:06.902857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db181-d166-4153-b619-9397881ecabc admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.907658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3124a7f-7b3b-4ad3-9ba0-e63f3bf519fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.909160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3124a7f-7b3b-4ad3-9ba0-e63f3bf519fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.909653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3124a7f-7b3b-4ad3-9ba0-e63f3bf519fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.910021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3124a7f-7b3b-4ad3-9ba0-e63f3bf519fc admin admin] PATH_INFO: `/v3/projects/7125bcd9638045f69426c6f9cde9b589/users/8863c38cb1e84a28b25b60f1c21960d5/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.912127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3124a7f-7b3b-4ad3-9ba0-e63f3bf519fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7125bcd9638045f69426c6f9cde9b589, user_id=8863c38cb1e84a28b25b60f1c21960d5, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.914850 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52042fd-be4d-4848-aadc-e4705dcb3354 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:06.914980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3124a7f-7b3b-4ad3-9ba0-e63f3bf519fc admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.918628 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:06.919293 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.919611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.919843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.925498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1283/2524] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:06 2022] PUT /identity/v3/projects/7125bcd9638045f69426c6f9cde9b589/users/8863c38cb1e84a28b25b60f1c21960d5/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:06.936910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:06.937187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:06.937504 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:06.965127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] MFA Rules not processed for user `8863c38cb1e84a28b25b60f1c21960d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:06.966463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:06.979424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:06.980951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:06.992699 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1242/2525] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:07.042275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1284/2526] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:07.054467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:07.056299 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:07.069622 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcd7fd-533c-4820-a496-5ce307cec587 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:07.130653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5d137-6ce1-487c-a667-606a5e0fd035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:07.131529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d137-6ce1-487c-a667-606a5e0fd035 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:07.131826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d137-6ce1-487c-a667-606a5e0fd035 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:07.132184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5d137-6ce1-487c-a667-606a5e0fd035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:07.144078 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5d137-6ce1-487c-a667-606a5e0fd035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:07.145688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5d137-6ce1-487c-a667-606a5e0fd035 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:07.155987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1243/2527] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:07.307653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:07.342084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:07.384363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef14de-2d71-417c-8b3d-2f4a911ffc45 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:07.390042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:07.390920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:07.391238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:07.391511 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] PATH_INFO: `/v3/users/885a2341bf8d4215a76aa487cb14c575` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:07.393378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=885a2341bf8d4215a76aa487cb14c575)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:07.395361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:07.449653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885a2341bf8d4215a76aa487cb14c575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:07.458888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885a2341bf8d4215a76aa487cb14c575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:07.459651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885a2341bf8d4215a76aa487cb14c575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:07.474901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885a2341bf8d4215a76aa487cb14c575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:07.482770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885a2341bf8d4215a76aa487cb14c575'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:07.489261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1285/2528] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:07 2022] DELETE /identity/v3/users/885a2341bf8d4215a76aa487cb14c575 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:07.494104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:07.494397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:07.494676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:07.512721 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:07.513918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:07.560156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:07.575796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1244/2529] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:07.585824 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:07.587480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:07.650528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ce0b1-c3b4-4f0f-9b19-4895c9c3a086 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:07.655218 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:07.655870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:07.656151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:07.656451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:07.666554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:07.668029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:07.678107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1286/2530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:07.971441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:07.973013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:07.991013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9e719-19a3-421a-bb05-082737acd558 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:07.997519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:07.998355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:07.998640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:07.998917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] PATH_INFO: `/v3/projects/294b7c7fd12349fa8f8863e8b0e87e03` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.000253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294b7c7fd12349fa8f8863e8b0e87e03)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:08.002424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:08.054749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294b7c7fd12349fa8f8863e8b0e87e03', 'request_id': 'req-b3986465-4d1b-477d-a011-a40377551768'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.063808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294b7c7fd12349fa8f8863e8b0e87e03', 'request_id': 'req-b3986465-4d1b-477d-a011-a40377551768'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.070851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294b7c7fd12349fa8f8863e8b0e87e03', 'request_id': 'req-b3986465-4d1b-477d-a011-a40377551768'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.082422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] The token cache is being invalidate because project 294b7c7fd12349fa8f8863e8b0e87e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:08.082771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.083526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.085197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1245/2531] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:07 2022] DELETE /identity/v3/projects/294b7c7fd12349fa8f8863e8b0e87e03 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:08.089425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:08.101756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f39484-b61c-4e2c-a01d-cd24ad42bf76 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:08.157079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:08.172549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:08.173492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:08.173804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:08.174094 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] PATH_INFO: `/v3/users/8863c38cb1e84a28b25b60f1c21960d5` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.175390 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8863c38cb1e84a28b25b60f1c21960d5)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:08.177314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:08.233827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8863c38cb1e84a28b25b60f1c21960d5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.245632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8863c38cb1e84a28b25b60f1c21960d5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.246240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8863c38cb1e84a28b25b60f1c21960d5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.260238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8863c38cb1e84a28b25b60f1c21960d5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.267542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-aa78a3eb-a74f-4541-b86e-193bee4bd738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8863c38cb1e84a28b25b60f1c21960d5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.278135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1287/2532] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:08 2022] DELETE /identity/v3/users/8863c38cb1e84a28b25b60f1c21960d5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:08.601355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:08.603360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:08.630350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3986465-4d1b-477d-a011-a40377551768 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:08.694156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:08.695102 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:08.695358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:08.695634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] PATH_INFO: `/v3/projects/7125bcd9638045f69426c6f9cde9b589` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.696827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7125bcd9638045f69426c6f9cde9b589)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:08.698805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:08.749443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7125bcd9638045f69426c6f9cde9b589', 'request_id': 'req-bed65e99-79a9-4696-a88c-8695ecaf84b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.760018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7125bcd9638045f69426c6f9cde9b589', 'request_id': 'req-bed65e99-79a9-4696-a88c-8695ecaf84b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.767756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7125bcd9638045f69426c6f9cde9b589', 'request_id': 'req-bed65e99-79a9-4696-a88c-8695ecaf84b5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.779585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] The token cache is being invalidate because project 7125bcd9638045f69426c6f9cde9b589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:08.779872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.780539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bed65e99-79a9-4696-a88c-8695ecaf84b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:08.782189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1246/2533] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:08 2022] DELETE /identity/v3/projects/7125bcd9638045f69426c6f9cde9b589 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:08.787261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:08.787764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:08.787874 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.806550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:08.807770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:08.869870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1288/2534] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:08.880485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:08.880769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:08.881049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.889268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:08.902072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:08.904061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:08.912587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1247/2535] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:08.916908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:08.927613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda1595-696c-44f1-99bb-5ca43123599c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:08.933268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:08.933978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:08.934255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:08.934514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.935268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:08.935623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:08.937246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:08.949737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1289/2536] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:08.954258 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:08.964265 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016312f-36b0-4de4-b2fb-6ebe1c7be2cd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:08.969356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:08.970033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:08.970308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:08.970899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:08.971867 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:08.973836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.009057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.009587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1248/2537] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:08 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:09.020107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191d1f1-ac7b-4965-963a-d795b447260e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.074100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:09.085751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.086468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.087025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.087570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.088548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.090624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.115276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1290/2538] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:09 2022] POST /identity/v3/users => generated 305 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:09.119400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.131725 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84973be-3f9d-40b3-9760-c376b9abfdeb admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.136759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.137771 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.138141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.138475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.139313 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.140996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.154555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1249/2539] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:09.158673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.169541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bdc88-4f53-402f-a528-ff4181f9ad83 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.175120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3901a8d-4a7d-48cf-b63e-40b18b22d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.175832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3901a8d-4a7d-48cf-b63e-40b18b22d9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.176110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3901a8d-4a7d-48cf-b63e-40b18b22d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.176378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3901a8d-4a7d-48cf-b63e-40b18b22d9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.177107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3901a8d-4a7d-48cf-b63e-40b18b22d9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.178904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3901a8d-4a7d-48cf-b63e-40b18b22d9ea admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.194188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1291/2540] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:09.195478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.206461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da541c-10f0-4c93-82d3-dbed2bf6274e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.211403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.212303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.212583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.212863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] PATH_INFO: `/v3/projects/cb6cec31f05f45668e01cdfa5a1f3e63/users/a72367f62c684cbe8c58f0372c5926a0/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.229383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6cec31f05f45668e01cdfa5a1f3e63, user_id=a72367f62c684cbe8c58f0372c5926a0, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.235420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.249827 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1250/2541] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:09 2022] PUT /identity/v3/projects/cb6cec31f05f45668e01cdfa5a1f3e63/users/a72367f62c684cbe8c58f0372c5926a0/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:09.261423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.261718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.261997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.290017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] MFA Rules not processed for user `a72367f62c684cbe8c58f0372c5926a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:09.291295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:09.358786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1292/2542] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:09.362925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.432322 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403aad4-1e08-4543-b040-f032e071e2e1 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.437580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.438252 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.438529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.438781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.440008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.442019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.471373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1251/2543] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:09 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:09.476813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.494012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458872b9-31c8-462d-86e8-9107e649af2b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.559433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.560417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.560669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.560940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.561676 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.563694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.587314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1293/2544] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:09 2022] POST /identity/v3/users => generated 311 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:09.591673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.603021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c607e4-1d97-4dce-bd24-440ec7c7a09b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.608759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.609629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.609904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.610286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.611237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.612858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.624106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1252/2545] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:09.628461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.639176 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28c14-d887-4aa5-9004-076f6ae6a162 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.645496 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.645985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.646499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.646712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] PATH_INFO: `/v3/projects/6c3b010ef88d4095ae14361ab0a9f1ec/users/b28978ade19048498db276bf6ba7f563/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.665216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3b010ef88d4095ae14361ab0a9f1ec, user_id=b28978ade19048498db276bf6ba7f563, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.668208 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.688860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1294/2546] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:09 2022] PUT /identity/v3/projects/6c3b010ef88d4095ae14361ab0a9f1ec/users/b28978ade19048498db276bf6ba7f563/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:09.694113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.704940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae933-c0d4-4305-a5b1-dcf6ed985519 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.789856 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.790727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.791172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.791540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.792442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.797014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.802610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.805023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:09.821599 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1253/2547] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:09.822184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45a13f-c444-4d6a-a750-e577cacadd6f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.825830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:09.828788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.830161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.831304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.831775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] PATH_INFO: `/v3/users/1d64897836b1443b80ab646205795eaa` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.833627 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d64897836b1443b80ab646205795eaa)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.835807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.836717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02aaa91-327d-4007-9149-33dc64086406 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:09.842315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4636c1f-1aa5-421a-9023-b949e9aa87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:09.843231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4636c1f-1aa5-421a-9023-b949e9aa87d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.843515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4636c1f-1aa5-421a-9023-b949e9aa87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.843789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4636c1f-1aa5-421a-9023-b949e9aa87d8 admin admin] PATH_INFO: `/v3/projects/6c3b010ef88d4095ae14361ab0a9f1ec/users/b28978ade19048498db276bf6ba7f563/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.847083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4636c1f-1aa5-421a-9023-b949e9aa87d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3b010ef88d4095ae14361ab0a9f1ec, user_id=b28978ade19048498db276bf6ba7f563, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:09.851022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4636c1f-1aa5-421a-9023-b949e9aa87d8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:09.858789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:09.866512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1254/2548] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:09 2022] PUT /identity/v3/projects/6c3b010ef88d4095ae14361ab0a9f1ec/users/b28978ade19048498db276bf6ba7f563/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:09.873940 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:DELETE=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:09.878995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.879306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.879556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.919146 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] MFA Rules not processed for user `b28978ade19048498db276bf6ba7f563`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:09.920409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:09.929017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d64897836b1443b80ab646205795eaa'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:09.942118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d64897836b1443b80ab646205795eaa'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:09.942875 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d64897836b1443b80ab646205795eaa'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:09.955241 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d64897836b1443b80ab646205795eaa'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:09.961980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-315b225d-4c07-49bf-8c0f-beb9df4fe140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d64897836b1443b80ab646205795eaa'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:09.967996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1295/2549] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:09 2022] DELETE /identity/v3/users/1d64897836b1443b80ab646205795eaa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:09.972686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:09.972980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:09.973259 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:09.990720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:09.991903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:09.994772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1255/2550] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:10.006134 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:10.007527 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:10.053459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1296/2551] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:10.063225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:10.065082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:10.067052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98414f13-faa9-48c8-a938-949b24c34edb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:10.118259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:10.118989 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:10.119270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:10.120261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:10.123854 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8954123-b3ea-4b84-bf69-e137188d8fc7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:10.128446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:10.129097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:10.129449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:10.129730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:10.139891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:10.141417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:10.151832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1297/2552] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:10.174992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:10.190303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:10.191778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:10.202030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1256/2553] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:10.383623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:10.393782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df165ee-78a2-4749-8abf-bc13788a069b service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:10.397526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:10.398184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:10.398462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:10.398737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:10.400597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:10.447999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:10.454851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:10.457356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:10.472717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:10.474471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:10.479894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0380d-bf7b-4470-b33e-5a7d91eaa122 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:10.485052 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1298/2554] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:10.486772 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:10.488014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:10.488477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:10.488926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] PATH_INFO: `/v3/projects/3b2852d391b34feb81a8036549a1a816` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:10.491779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2852d391b34feb81a8036549a1a816)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:10.495435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:10.554045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2852d391b34feb81a8036549a1a816', 'request_id': 'req-0b9c8c89-92aa-4088-80b8-8342fb023b93'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.563107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2852d391b34feb81a8036549a1a816', 'request_id': 'req-0b9c8c89-92aa-4088-80b8-8342fb023b93'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.570158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2852d391b34feb81a8036549a1a816', 'request_id': 'req-0b9c8c89-92aa-4088-80b8-8342fb023b93'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.582537 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] The token cache is being invalidate because project 3b2852d391b34feb81a8036549a1a816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:10.582826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.583500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.585101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1257/2555] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:10 2022] DELETE /identity/v3/projects/3b2852d391b34feb81a8036549a1a816 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:10.589212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:10.601081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d114794-705a-4e5a-bbc3-0d9d0d04d8c7 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:10.666238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:10.667146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:10.667418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:10.667707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] PATH_INFO: `/v3/users/dd7fa3430e2b4c7cbdbff0fdd0e31cf5` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:10.668972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7fa3430e2b4c7cbdbff0fdd0e31cf5)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:10.671083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:10.725571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7fa3430e2b4c7cbdbff0fdd0e31cf5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.746728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7fa3430e2b4c7cbdbff0fdd0e31cf5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.746728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7fa3430e2b4c7cbdbff0fdd0e31cf5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.763618 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7fa3430e2b4c7cbdbff0fdd0e31cf5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.771723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d376ea72-4369-407a-9147-98533a2c88b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7fa3430e2b4c7cbdbff0fdd0e31cf5'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:10.778881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1299/2556] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:10 2022] DELETE /identity/v3/users/dd7fa3430e2b4c7cbdbff0fdd0e31cf5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:11.074432 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.075955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:11.094305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c8c89-92aa-4088-80b8-8342fb023b93 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.157926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.158970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.159323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.159675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] PATH_INFO: `/v3/projects/0110e9aa178b4bf19e76f6073748e39a` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.160820 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0110e9aa178b4bf19e76f6073748e39a)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.162810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.218488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0110e9aa178b4bf19e76f6073748e39a', 'request_id': 'req-dd3a1693-8039-4071-aea7-108c0f84a165'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:11.237171 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0110e9aa178b4bf19e76f6073748e39a', 'request_id': 'req-dd3a1693-8039-4071-aea7-108c0f84a165'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:11.245222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0110e9aa178b4bf19e76f6073748e39a', 'request_id': 'req-dd3a1693-8039-4071-aea7-108c0f84a165'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:11.256233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] The token cache is being invalidate because project 0110e9aa178b4bf19e76f6073748e39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:11.256521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:11.257191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-dd3a1693-8039-4071-aea7-108c0f84a165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:11.258806 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1258/2557] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:11 2022] DELETE /identity/v3/projects/0110e9aa178b4bf19e76f6073748e39a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:11.264015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.264546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.264546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.290491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:11.291723 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:11.347850 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:11.358260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1300/2558] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:11.367059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.367354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.367627 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.374974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:11.392029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:11.394052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:11.404039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1259/2559] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:11.409476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.425740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6554ef-fe83-4372-b402-2e4fd88079eb None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.433421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.434468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.434852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.435222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.436110 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:11.436578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.438344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.457347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1301/2560] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:11.459071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.468939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326b863-bb14-4b52-a9d6-8c22f44d9893 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.475267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.475941 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.476225 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.476489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.477191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.479287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.516220 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1260/2561] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:11.518351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.529143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb669ef8-bd52-4286-bf63-bc1910b77716 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.594194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.594886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.595168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.595495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.596184 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.598146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.619145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1302/2562] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:11.623465 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.634156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfa733-8ac1-4aaf-bdba-a259a4d0b91c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.639268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.639945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.640224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.640496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.641237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.643106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.654740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1261/2563] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:11.659068 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.669889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53147eeb-4a01-46ac-83be-c056d1d72ef4 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.675919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128cea-c796-4dea-a4ef-22fdad03ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.676579 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128cea-c796-4dea-a4ef-22fdad03ce0b admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.676865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128cea-c796-4dea-a4ef-22fdad03ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.677140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128cea-c796-4dea-a4ef-22fdad03ce0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.677916 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24128cea-c796-4dea-a4ef-22fdad03ce0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.679527 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24128cea-c796-4dea-a4ef-22fdad03ce0b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.690239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1303/2564] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:11.694638 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.706361 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c310-59bd-4321-906d-0d3db9fb9980 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.712826 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.713790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.714075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.714335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] PATH_INFO: `/v3/projects/52cd10ff87fb4f3ea9d907cc39356d86/users/552d1c248a46451586135ff089661891/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.731013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cd10ff87fb4f3ea9d907cc39356d86, user_id=552d1c248a46451586135ff089661891, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.733716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.749851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1262/2565] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:11 2022] PUT /identity/v3/projects/52cd10ff87fb4f3ea9d907cc39356d86/users/552d1c248a46451586135ff089661891/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:11.760681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.760975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.761258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.791457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] MFA Rules not processed for user `552d1c248a46451586135ff089661891`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:11.792654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:11.866000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1304/2566] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:11.870555 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.934484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c936e8-a4bb-4c26-a86c-717d1cffefca admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:11.940905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:11.941763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:11.942128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:11.942415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:11.943137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:11.945063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:11.973097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1263/2567] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:11.977431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:11.988417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3424f8-f4db-462e-b56e-9260733f3070 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.063133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.063780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.064302 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:12.064993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.065612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.066608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.069619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.094911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1305/2568] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:11 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:12.096411 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.107459 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae6086-b0e4-4069-85e7-fa06993cdbeb admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.113404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.114088 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.114366 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.114634 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.115365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.116976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.128685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1264/2569] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:12.132832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.143531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b01211-638e-4d76-a48c-60da1d802389 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.148659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadcf7-c10c-4ec6-8b9f-f21a28e8c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.149367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadcf7-c10c-4ec6-8b9f-f21a28e8c61f admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.149665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadcf7-c10c-4ec6-8b9f-f21a28e8c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.149943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadcf7-c10c-4ec6-8b9f-f21a28e8c61f admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.150873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaadcf7-c10c-4ec6-8b9f-f21a28e8c61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.152861 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaadcf7-c10c-4ec6-8b9f-f21a28e8c61f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.164686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1306/2570] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:12.168921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.179373 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56372ff-8f17-4103-8736-d10a087ba724 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.184147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.185046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.185311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.185629 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] PATH_INFO: `/v3/projects/4c092f96eea3499ea558615e098bd1ef/users/9e66169895d2477ca7789280d6006b39/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.201937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c092f96eea3499ea558615e098bd1ef, user_id=9e66169895d2477ca7789280d6006b39, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.204608 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.219328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1265/2571] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:12 2022] PUT /identity/v3/projects/4c092f96eea3499ea558615e098bd1ef/users/9e66169895d2477ca7789280d6006b39/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:12.231423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.231712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.231986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.267740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] MFA Rules not processed for user `9e66169895d2477ca7789280d6006b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:12.268982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:12.346430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1307/2572] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:12.351350 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.405696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:12.425395 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261b5e2-0235-42bc-8536-95dc06601cd9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.430797 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.431473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.431758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.432038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.432758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.434733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.464194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1266/2573] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:12 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:12.468635 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.480779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046b427-d372-47f4-85f8-4e4cef11f28e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.546768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.548358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.548358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.548358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.549260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.552121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.582935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1308/2574] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:12 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:12.589105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.602488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834270-6911-4d20-be4f-a0c8d5903bab admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.607617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.608323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.608603 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.608879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.609654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.611397 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.623300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1267/2575] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:12.628313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.638952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b32f12-75d8-484b-ac85-4b7b3ef0aa22 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.644995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.645923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.646202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.646476 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] PATH_INFO: `/v3/projects/aa2e22963b86471282fa41adcb40795f/users/01b2e4fa2b36413bbd880d9d62b43480/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.662686 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2e22963b86471282fa41adcb40795f, user_id=01b2e4fa2b36413bbd880d9d62b43480, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.665339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.685057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1309/2576] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:12 2022] PUT /identity/v3/projects/aa2e22963b86471282fa41adcb40795f/users/01b2e4fa2b36413bbd880d9d62b43480/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:12.689915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.700858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8456d-aad1-4bb0-b5ab-64137ddb3e57 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.762086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4a583-2181-4a71-9a7f-9045ba5a1d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.762738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a583-2181-4a71-9a7f-9045ba5a1d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.763026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a583-2181-4a71-9a7f-9045ba5a1d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.763303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4a583-2181-4a71-9a7f-9045ba5a1d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.764058 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a583-2181-4a71-9a7f-9045ba5a1d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.765722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4a583-2181-4a71-9a7f-9045ba5a1d5e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.776807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1268/2577] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:12.782114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.793170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2993ac4-7647-47dd-8108-bc179462ebff admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:12.798453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:12.799370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.800288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.800577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] PATH_INFO: `/v3/projects/aa2e22963b86471282fa41adcb40795f/users/01b2e4fa2b36413bbd880d9d62b43480/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.802718 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2e22963b86471282fa41adcb40795f, user_id=01b2e4fa2b36413bbd880d9d62b43480, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:12.805436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:12.816130 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1310/2578] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:12 2022] PUT /identity/v3/projects/aa2e22963b86471282fa41adcb40795f/users/01b2e4fa2b36413bbd880d9d62b43480/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:12.830960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:12.831260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:12.831553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:12.860184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] MFA Rules not processed for user `01b2e4fa2b36413bbd880d9d62b43480`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:12.862150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:12.940586 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1269/2579] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:12.952880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:12.955897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:12.978118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:13.021739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae9f8a-28df-4003-867b-3dd9e6aad67d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:13.025581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:13.026238 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:13.026890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:13.027172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:13.036688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:13.038162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:13.048098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1311/2580] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:13.092647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:13.094262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:13.107713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897cd6-e8cc-4c5d-bb2b-38cefbdca820 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:13.111726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:13.112339 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:13.112587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:13.112897 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:13.163578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:13.182131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:13.184030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:13.197908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1270/2581] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:15.992178 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:15.993678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:16.063906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c14e37-370b-478c-a933-556f13164b1c service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:16.067946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:16.068611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:16.068900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:16.069221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:16.071097 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:16.147477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:16.148953 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7c84a-b365-433b-aff7-a9e43dd4adc3 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:16.160070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1312/2582] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:17.202072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:17.286781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39b6f1-28c7-4560-82d8-a202a003bf98 service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:17.292006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:17.292920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:17.293203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:17.293507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] PATH_INFO: `/v3/users/552d1c248a46451586135ff089661891` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:17.294753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=552d1c248a46451586135ff089661891)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:17.296703 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:17.356144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552d1c248a46451586135ff089661891'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:17.364938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552d1c248a46451586135ff089661891'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:17.373737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552d1c248a46451586135ff089661891'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:17.374563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552d1c248a46451586135ff089661891'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:17.389525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552d1c248a46451586135ff089661891'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:17.397229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1271/2583] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:17 2022] DELETE /identity/v3/users/552d1c248a46451586135ff089661891 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:17.402425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:17.403007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:17.403230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:17.422741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:17.424261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:17.493465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1313/2584] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:17.503408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:17.504943 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:17.570843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11ffc-465a-4a8b-8618-870bb13c90ce admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:17.574801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cbb84-71d0-4db5-8ae2-c2faef93730b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:17.575457 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cbb84-71d0-4db5-8ae2-c2faef93730b service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:17.575717 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cbb84-71d0-4db5-8ae2-c2faef93730b service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:17.575987 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cbb84-71d0-4db5-8ae2-c2faef93730b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:17.586823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cbb84-71d0-4db5-8ae2-c2faef93730b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:17.588268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137cbb84-71d0-4db5-8ae2-c2faef93730b service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:17.600488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1272/2585] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:17.911882 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:17.913665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:17.926412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b67a5-e111-4fea-95c9-a8c0bad576a1 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:17.932271 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:17.933169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:17.933522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:17.933928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] PATH_INFO: `/v3/users/a72367f62c684cbe8c58f0372c5926a0` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:17.935225 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72367f62c684cbe8c58f0372c5926a0)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:17.937221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:17.940589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:17.991057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72367f62c684cbe8c58f0372c5926a0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.001899 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72367f62c684cbe8c58f0372c5926a0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.002478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72367f62c684cbe8c58f0372c5926a0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.015134 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72367f62c684cbe8c58f0372c5926a0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.022528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72367f62c684cbe8c58f0372c5926a0'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.030120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1314/2586] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:17 2022] DELETE /identity/v3/users/a72367f62c684cbe8c58f0372c5926a0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:18.035046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:18.035391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:18.035674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:18.042661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:18.047570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:18.049156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:18.055229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:18.057948 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:18.150035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1273/2587] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:18.161953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:18.162189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4736b-1841-4246-9219-e8e328ab8284 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:18.165434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:18.167927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:18.169016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:18.169568 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:18.169994 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] PATH_INFO: `/v3/projects/52cd10ff87fb4f3ea9d907cc39356d86` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:18.171381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cd10ff87fb4f3ea9d907cc39356d86)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:18.173589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:18.253291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cd10ff87fb4f3ea9d907cc39356d86', 'request_id': 'req-ac0672dc-a0dc-4074-9f0e-f73d16158db4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.258939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3df28-cfa7-49fa-bf70-c76267601ba5 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:18.260497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cd10ff87fb4f3ea9d907cc39356d86', 'request_id': 'req-ac0672dc-a0dc-4074-9f0e-f73d16158db4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.267029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cd10ff87fb4f3ea9d907cc39356d86', 'request_id': 'req-ac0672dc-a0dc-4074-9f0e-f73d16158db4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.285281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] The token cache is being invalidate because project 52cd10ff87fb4f3ea9d907cc39356d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:18.285799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.286673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.288339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1315/2588] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:18 2022] DELETE /identity/v3/projects/52cd10ff87fb4f3ea9d907cc39356d86 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:18.292892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:18.294630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:18.313431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:18.320311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:18.321083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:18.321404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:18.321686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:18.323785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:18.386946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0672dc-a0dc-4074-9f0e-f73d16158db4 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:18.399883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:18.401716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:18.402214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:18.402495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] PATH_INFO: `/v3/users/9e66169895d2477ca7789280d6006b39` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:18.403779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e66169895d2477ca7789280d6006b39)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:18.406058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:18.419738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:18.425942 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:18.441976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1274/2589] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:18.484202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e66169895d2477ca7789280d6006b39'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.498375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e66169895d2477ca7789280d6006b39'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.499177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e66169895d2477ca7789280d6006b39'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.522381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e66169895d2477ca7789280d6006b39'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.533753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e66169895d2477ca7789280d6006b39'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:18.541925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1316/2590] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:18 2022] DELETE /identity/v3/users/9e66169895d2477ca7789280d6006b39 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:18.917028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:18.929999 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e675f9-998d-4c3c-97e4-23124c3e32a0 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:18.941468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:18.943152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:18.944679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:19.028536 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:19.029648 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:19.029933 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:19.030253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] PATH_INFO: `/v3/projects/4c092f96eea3499ea558615e098bd1ef` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:19.031715 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c092f96eea3499ea558615e098bd1ef)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:19.034053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:19.095338 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207d5df-833a-42cd-bf93-4ef8b1fe5a57 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:19.112685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c092f96eea3499ea558615e098bd1ef', 'request_id': 'req-3b5dea29-6a85-402c-9241-02ebb41f0158'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.122906 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c092f96eea3499ea558615e098bd1ef', 'request_id': 'req-3b5dea29-6a85-402c-9241-02ebb41f0158'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.131273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c092f96eea3499ea558615e098bd1ef', 'request_id': 'req-3b5dea29-6a85-402c-9241-02ebb41f0158'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.137277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:19.147268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] The token cache is being invalidate because project 4c092f96eea3499ea558615e098bd1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:19.147558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.148221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.150138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1275/2591] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:18 2022] DELETE /identity/v3/projects/4c092f96eea3499ea558615e098bd1ef => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:19.155269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:19.156875 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:19.167413 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:19.168371 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:19.168717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:19.169058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] PATH_INFO: `/v3/projects/cb6cec31f05f45668e01cdfa5a1f3e63` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:19.170493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6cec31f05f45668e01cdfa5a1f3e63)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:19.172327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:19.228509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dea29-6a85-402c-9241-02ebb41f0158 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:19.231692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6cec31f05f45668e01cdfa5a1f3e63', 'request_id': 'req-7f5ba12b-2079-4ded-8886-7967e420896a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.241624 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6cec31f05f45668e01cdfa5a1f3e63', 'request_id': 'req-7f5ba12b-2079-4ded-8886-7967e420896a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.248766 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6cec31f05f45668e01cdfa5a1f3e63', 'request_id': 'req-7f5ba12b-2079-4ded-8886-7967e420896a'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.264745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] The token cache is being invalidate because project cb6cec31f05f45668e01cdfa5a1f3e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:19.265089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.265699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.270388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1317/2592] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:18 2022] DELETE /identity/v3/projects/cb6cec31f05f45668e01cdfa5a1f3e63 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:19.272464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:19.274037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:19.285147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:19.300885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:19.304324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:19.304625 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:19.305890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] PATH_INFO: `/v3/users/01b2e4fa2b36413bbd880d9d62b43480` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:19.307376 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b2e4fa2b36413bbd880d9d62b43480)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:19.309425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:19.349095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba12b-2079-4ded-8886-7967e420896a admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:19.355054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:19.356060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:19.356374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:19.356682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] PATH_INFO: `/v3/users/b28978ade19048498db276bf6ba7f563` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:19.358021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28978ade19048498db276bf6ba7f563)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:19.360181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:19.387921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b2e4fa2b36413bbd880d9d62b43480'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.398156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b2e4fa2b36413bbd880d9d62b43480'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.408290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b2e4fa2b36413bbd880d9d62b43480'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.409270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b2e4fa2b36413bbd880d9d62b43480'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.422491 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28978ade19048498db276bf6ba7f563'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.425666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b2e4fa2b36413bbd880d9d62b43480'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.432662 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28978ade19048498db276bf6ba7f563'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.433877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28978ade19048498db276bf6ba7f563'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.435367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1276/2593] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:19 2022] DELETE /identity/v3/users/01b2e4fa2b36413bbd880d9d62b43480 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:19.447495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:19.448977 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28978ade19048498db276bf6ba7f563'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.465411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28978ade19048498db276bf6ba7f563'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.477943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1318/2594] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:19 2022] DELETE /identity/v3/users/b28978ade19048498db276bf6ba7f563 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:19.823759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:19.825514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:19.849567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:19.851452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:19.911294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bc73d-e183-417c-8306-23db98dde3a3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:19.927985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61e5d-6769-49a2-a0f4-33f406c3c60c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:19.932628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:19.933539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:19.933821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:19.934096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] PATH_INFO: `/v3/projects/6c3b010ef88d4095ae14361ab0a9f1ec` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:19.935287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3b010ef88d4095ae14361ab0a9f1ec)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:19.937217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:19.969880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:19.970946 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:19.971232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:19.971515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] PATH_INFO: `/v3/projects/aa2e22963b86471282fa41adcb40795f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:19.972738 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa2e22963b86471282fa41adcb40795f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:19.974692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:19.984510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3b010ef88d4095ae14361ab0a9f1ec', 'request_id': 'req-7d162809-6a2f-4d8f-9945-5821f237c1bf'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.990567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3b010ef88d4095ae14361ab0a9f1ec', 'request_id': 'req-7d162809-6a2f-4d8f-9945-5821f237c1bf'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:19.991576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:19.997573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3b010ef88d4095ae14361ab0a9f1ec', 'request_id': 'req-7d162809-6a2f-4d8f-9945-5821f237c1bf'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.012170 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] The token cache is being invalidate because project 6c3b010ef88d4095ae14361ab0a9f1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:20.012489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.013092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7d162809-6a2f-4d8f-9945-5821f237c1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.014713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1319/2595] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:19 2022] DELETE /identity/v3/projects/6c3b010ef88d4095ae14361ab0a9f1ec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:20.020437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a318b0-5bce-4e5d-b270-57841ce8ea32 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.020805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a318b0-5bce-4e5d-b270-57841ce8ea32 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.021444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a318b0-5bce-4e5d-b270-57841ce8ea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.023781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa2e22963b86471282fa41adcb40795f', 'request_id': 'req-69932b1b-98a1-4925-88a6-cbbbe85326b2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.031750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa2e22963b86471282fa41adcb40795f', 'request_id': 'req-69932b1b-98a1-4925-88a6-cbbbe85326b2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.038621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa2e22963b86471282fa41adcb40795f', 'request_id': 'req-69932b1b-98a1-4925-88a6-cbbbe85326b2'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.040825 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-a3a318b0-5bce-4e5d-b270-57841ce8ea32 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:20.042086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-a3a318b0-5bce-4e5d-b270-57841ce8ea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:20.049314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] The token cache is being invalidate because project aa2e22963b86471282fa41adcb40795f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:20.049633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.050286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-69932b1b-98a1-4925-88a6-cbbbe85326b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:20.052063 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1277/2596] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:19 2022] DELETE /identity/v3/projects/aa2e22963b86471282fa41adcb40795f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:20.057953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.058243 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.058532 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.077135 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:20.078319 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:20.103904 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1320/2597] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:20.111612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6dd0-50b0-4634-9983-68cce48a5ae8 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.111903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6dd0-50b0-4634-9983-68cce48a5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.112186 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6dd0-50b0-4634-9983-68cce48a5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.129818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c50b6dd0-50b0-4634-9983-68cce48a5ae8 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:20.131040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c50b6dd0-50b0-4634-9983-68cce48a5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:20.139098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1278/2598] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:20.140051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1321/2599] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:20.144564 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.147680 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.147978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.148267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.154686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd0faa-7907-4306-b582-a1034c4cf2c2 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.160402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.161080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.161388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.161665 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.162407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:20.162720 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.164331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.167746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:20.169046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:20.181416 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1279/2600] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:23:20.181699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1322/2601] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:20.183507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.184216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.195493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:20.200416 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e4cae-cb9c-48c9-9846-f24d738db6e4 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.200706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede11da3-af28-4d7d-abfe-c5a58c7aa0cf admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.208729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.208958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.209453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.209576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.209810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.210106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.210223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.210630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.210800 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.211821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:20.212261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.212972 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.213907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.226849 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1323/2602] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:20.231705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.242653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8df161-c168-4d88-818b-6143b7d48688 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.247372 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.247994 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1280/2603] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:20.248127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.248319 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.248603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.249308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.251279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.252028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.283584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1324/2604] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:20.285096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.318652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700675e-9177-4839-b8e8-bcab2be2aa9a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.334345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:20.351148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacfc98-8a58-48a9-80e0-35f7578413a9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.356755 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.357472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.357760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.358037 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.358728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.360769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.381254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.382015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.382298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.382573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.383120 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1325/2605] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:20.383273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.385275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.387101 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.397890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53f43-6dbc-44df-a62d-754cfd9ce635 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.403027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.403712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.404146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.404317 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.404996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.406634 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.412671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1281/2606] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:20.413807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.420071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1326/2607] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:20.421192 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.426386 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37926b3-3675-4a53-b961-b9c52c7c22bc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.431838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.432251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec288f80-46ec-4e79-a679-36e1e2fe8b62 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.432752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.433198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.433593 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.434462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.436177 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.437842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.438524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.438814 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.439142 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.439888 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.441540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.447945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1282/2608] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:20.452306 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.462267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1327/2609] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:20.463421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.467716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ffe45-17bc-447b-9ae6-4d173a5c84ba admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.473279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.474198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.474480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.474763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.475512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.475664 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88cc79-7175-4405-83eb-d13283e76365 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.477154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.481026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6564b78-e454-4f69-809e-cced69086c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.481961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6564b78-e454-4f69-809e-cced69086c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.482245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6564b78-e454-4f69-809e-cced69086c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.482525 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6564b78-e454-4f69-809e-cced69086c1c admin admin] PATH_INFO: `/v3/projects/ebf4362e210e47baad8c53741706d003/users/6468745e95cd4f468fc8c8f5ed51165d/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.488380 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1283/2610] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:20.492417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.499148 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6564b78-e454-4f69-809e-cced69086c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf4362e210e47baad8c53741706d003, user_id=6468745e95cd4f468fc8c8f5ed51165d, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.501919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6564b78-e454-4f69-809e-cced69086c1c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.502150 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910c66-41ca-4020-b4fb-612139547807 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.506823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa1f98-e738-4b78-9f18-e0022c51dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.507848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa1f98-e738-4b78-9f18-e0022c51dfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.508128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa1f98-e738-4b78-9f18-e0022c51dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.508430 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa1f98-e738-4b78-9f18-e0022c51dfd5 admin admin] PATH_INFO: `/v3/projects/e1a2dacc83ae49559784a7c7691d8098/users/d6f2371f3297461eb69c651d61202579/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.517026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1328/2611] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:20 2022] PUT /identity/v3/projects/ebf4362e210e47baad8c53741706d003/users/6468745e95cd4f468fc8c8f5ed51165d/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:20.524811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa1f98-e738-4b78-9f18-e0022c51dfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a2dacc83ae49559784a7c7691d8098, user_id=d6f2371f3297461eb69c651d61202579, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.528000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa1f98-e738-4b78-9f18-e0022c51dfd5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.530848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.531124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.531402 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.541655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1284/2612] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:20 2022] PUT /identity/v3/projects/e1a2dacc83ae49559784a7c7691d8098/users/d6f2371f3297461eb69c651d61202579/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:20.553548 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.553838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.554113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.559648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] MFA Rules not processed for user `6468745e95cd4f468fc8c8f5ed51165d`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:20.561062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:20.580502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] MFA Rules not processed for user `d6f2371f3297461eb69c651d61202579`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:20.581953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:20.629394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1329/2613] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:20.633852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.639061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:20.647147 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1285/2614] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:20.652076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.704279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f579be-3aa3-44ac-9276-be6c2ce88ca0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.705159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:20.710153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.710823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.711103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.711378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.712072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.714147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.718784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaab38-81b1-41ae-b810-dde2ac065ff3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.728783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.729507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.729885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.730188 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.730977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.733116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.745936 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1330/2615] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:20.751433 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.763655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1286/2616] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:20.768239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.827828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280555b-0471-4964-a147-ce55f77a8eee admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.833421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.834159 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.834450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.834771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.835626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.837759 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.838448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bedd4-a3df-4d5e-b67f-e9fae4d823df admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.848314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.849164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.849480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.850092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.850609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.853055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.861815 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1331/2617] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:20.864537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.875079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044e3a2-0a0d-4d93-b71c-517666753340 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.879776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1287/2618] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:20 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:20.880966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.881247 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.881961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.882245 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.882490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.883231 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.884852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.896547 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1332/2619] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:20.896740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3e32a-7cd3-4740-b40b-3289dc729dcc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.900991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.901818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.902503 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.902786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.903069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.903818 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.905487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.912694 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c7a3e-9e5a-45e7-a581-3daaf8b7c592 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.917383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1288/2620] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:20.922379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.922719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.923751 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.924038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.924310 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] PATH_INFO: `/v3/projects/b2d4c623b24f40869ff1267cb27e6e66/users/d7c5a100fd5749e1a155e6616a6db2e7/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.942035 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02970d92-4e98-455a-a394-1c92b305eb2d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:20.947428 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:20.947652 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d4c623b24f40869ff1267cb27e6e66, user_id=d7c5a100fd5749e1a155e6616a6db2e7, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.948480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:20.948835 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:20.949186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] PATH_INFO: `/v3/projects/cc817692259b49d7bb24310d92854149/users/22a1d1cd725b45a4bfe513be157302f4/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:20.951017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.967567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc817692259b49d7bb24310d92854149, user_id=22a1d1cd725b45a4bfe513be157302f4, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:20.968996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1333/2621] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:20 2022] PUT /identity/v3/projects/b2d4c623b24f40869ff1267cb27e6e66/users/d7c5a100fd5749e1a155e6616a6db2e7/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:20.971156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:20.973993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:20.988689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1289/2622] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:20 2022] PUT /identity/v3/projects/cc817692259b49d7bb24310d92854149/users/22a1d1cd725b45a4bfe513be157302f4/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:20.992977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:21.026265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:21.046128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f964474-2a32-412b-a03c-7bcefbbfba6d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.061382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86801f5e-5e54-4c18-8288-4012942fcb6a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.068219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.069400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.069920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.070328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.071480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.074126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.099714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1290/2623] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:21.101289 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:21.112104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19b242-f0dd-4a93-892e-423857ebed8c admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.114457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.115173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.115454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.115876 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.116614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.117571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2490f-a5c0-40a1-93e0-f5449e958ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.118251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.118473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2490f-a5c0-40a1-93e0-f5449e958ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.118789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2490f-a5c0-40a1-93e0-f5449e958ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.119232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2490f-a5c0-40a1-93e0-f5449e958ceb admin admin] PATH_INFO: `/v3/projects/cc817692259b49d7bb24310d92854149/users/22a1d1cd725b45a4bfe513be157302f4/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.121893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2490f-a5c0-40a1-93e0-f5449e958ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc817692259b49d7bb24310d92854149, user_id=22a1d1cd725b45a4bfe513be157302f4, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.124529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2490f-a5c0-40a1-93e0-f5449e958ceb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.129498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1334/2624] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:21.133615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:21.136652 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1291/2625] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:21 2022] PUT /identity/v3/projects/cc817692259b49d7bb24310d92854149/users/22a1d1cd725b45a4bfe513be157302f4/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:21.145016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9e63b-e95c-46df-b70b-0a0d92a94b25 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.147114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.147403 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.148005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.176647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:21.180792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] MFA Rules not processed for user `22a1d1cd725b45a4bfe513be157302f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:21.183323 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:21.207592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aaaf4-857c-47ab-8375-5144826a6773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.208510 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaaf4-857c-47ab-8375-5144826a6773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.208793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaaf4-857c-47ab-8375-5144826a6773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.209072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aaaf4-857c-47ab-8375-5144826a6773 admin admin] PATH_INFO: `/v3/projects/b2d4c623b24f40869ff1267cb27e6e66/users/d7c5a100fd5749e1a155e6616a6db2e7/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.212014 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aaaf4-857c-47ab-8375-5144826a6773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d4c623b24f40869ff1267cb27e6e66, user_id=d7c5a100fd5749e1a155e6616a6db2e7, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.215053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aaaf4-857c-47ab-8375-5144826a6773 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.229638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1335/2626] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:21 2022] PUT /identity/v3/projects/b2d4c623b24f40869ff1267cb27e6e66/users/d7c5a100fd5749e1a155e6616a6db2e7/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:21.240689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.240978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.241251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.255793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1292/2627] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:21.266792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:21.268442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:21.271032 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] MFA Rules not processed for user `d7c5a100fd5749e1a155e6616a6db2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:21.272224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:21.330355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f88d9-2acc-4735-8da1-0e85dea2b3d4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.345471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1336/2628] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:21.357678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:21.359307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:21.366051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:21.386925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d27ee-1392-4fdb-8ed6-0b10c8957bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.387604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d27ee-1392-4fdb-8ed6-0b10c8957bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.387958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d27ee-1392-4fdb-8ed6-0b10c8957bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.388295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d27ee-1392-4fdb-8ed6-0b10c8957bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.422565 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4569ec-e48b-45a9-815a-2afc5d6dab3b None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.427309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.428277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.428701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.429144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.441268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.442768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.447081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d27ee-1392-4fdb-8ed6-0b10c8957bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.449448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d27ee-1392-4fdb-8ed6-0b10c8957bfe service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.458768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1337/2629] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:21.458986 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1293/2630] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:23:21.852787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:21.921046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65eac03-4239-4beb-8c27-057f2670a1ae service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:21.926757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:21.927639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:21.927926 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:21.928205 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] PATH_INFO: `/v3/users/6468745e95cd4f468fc8c8f5ed51165d` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:21.929498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6468745e95cd4f468fc8c8f5ed51165d)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:21.931446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:21.981998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6468745e95cd4f468fc8c8f5ed51165d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:21.991405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6468745e95cd4f468fc8c8f5ed51165d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:21.992146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6468745e95cd4f468fc8c8f5ed51165d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.005198 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6468745e95cd4f468fc8c8f5ed51165d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.012739 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6468745e95cd4f468fc8c8f5ed51165d'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.019332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1338/2631] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:21 2022] DELETE /identity/v3/users/6468745e95cd4f468fc8c8f5ed51165d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:22.025601 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:22.025898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:22.026178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:22.046120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:22.047384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:22.052166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:22.111693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1294/2632] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:22.121661 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:22.123172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:22.156692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:22.186353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d4e52-c7da-4244-840d-add5bda49ed9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:22.190932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:22.191598 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:22.191882 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:22.192154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:22.202781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:22.204240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:22.214891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1339/2633] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:22.523796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:22.525308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:22.543467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3997c-2506-4791-85cd-5af11a63530b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:22.552153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:22.553090 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:22.553407 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:22.553691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] PATH_INFO: `/v3/projects/ebf4362e210e47baad8c53741706d003` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:22.554963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf4362e210e47baad8c53741706d003)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:22.557121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:22.609365 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf4362e210e47baad8c53741706d003', 'request_id': 'req-ff7aad82-d751-4d73-949a-cad274f649b9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.618435 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf4362e210e47baad8c53741706d003', 'request_id': 'req-ff7aad82-d751-4d73-949a-cad274f649b9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.625496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf4362e210e47baad8c53741706d003', 'request_id': 'req-ff7aad82-d751-4d73-949a-cad274f649b9'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.637723 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] The token cache is being invalidate because project ebf4362e210e47baad8c53741706d003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:22.638242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.639050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.640573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1295/2634] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:22 2022] DELETE /identity/v3/projects/ebf4362e210e47baad8c53741706d003 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:22.644961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:22.655445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801e07-3cda-4357-8f19-3540656ca528 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:22.719689 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:22.720574 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:22.721263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:22.721263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] PATH_INFO: `/v3/users/d7c5a100fd5749e1a155e6616a6db2e7` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:22.722337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c5a100fd5749e1a155e6616a6db2e7)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:22.724287 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:22.773923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c5a100fd5749e1a155e6616a6db2e7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.782804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c5a100fd5749e1a155e6616a6db2e7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.783505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c5a100fd5749e1a155e6616a6db2e7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.796056 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c5a100fd5749e1a155e6616a6db2e7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.803421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-cddadf67-3432-411f-b691-38d26a7d0a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c5a100fd5749e1a155e6616a6db2e7'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:22.809626 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1340/2635] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:22 2022] DELETE /identity/v3/users/d7c5a100fd5749e1a155e6616a6db2e7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:23.110281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.111781 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:23.128829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7aad82-d751-4d73-949a-cad274f649b9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.208808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.209808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.210066 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.210358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] PATH_INFO: `/v3/projects/b2d4c623b24f40869ff1267cb27e6e66` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.211618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d4c623b24f40869ff1267cb27e6e66)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.213651 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.273668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:23.286224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d4c623b24f40869ff1267cb27e6e66', 'request_id': 'req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:23.294379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d4c623b24f40869ff1267cb27e6e66', 'request_id': 'req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:23.302354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d4c623b24f40869ff1267cb27e6e66', 'request_id': 'req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:23.313688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] The token cache is being invalidate because project b2d4c623b24f40869ff1267cb27e6e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:23.314142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:23.314904 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-571fdd82-e0b3-4416-825c-a02aa7cb3bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:23.316620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1296/2636] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:23 2022] DELETE /identity/v3/projects/b2d4c623b24f40869ff1267cb27e6e66 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:23.322091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.322379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.322659 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.341112 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:23.342368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:23.394667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:23.413764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1341/2637] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:23.422647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.422936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.423211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.449197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:23.450559 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:23.462073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1297/2638] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:23.466620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.479972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b26c8-b855-4887-96b9-4e8d7ce1266e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.482709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.483439 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.483725 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.484006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.484749 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:23.485067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.488884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.503341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1342/2639] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:23:23.506488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.516860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fdfd5-d60a-4bad-bd1e-69f0886fa224 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.522930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.523596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.523878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.524512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.524831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.527141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.562543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1298/2640] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:23 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:23.567758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.578467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278c27a-8a93-4119-8fd9-a330bd359109 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.640002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.640696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.640982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.641299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.642008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.644098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.667947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1343/2641] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:23 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:23.669244 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.681024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3ea0e-0d36-44b0-a656-749e01eb49d9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.686155 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.686879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.687160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.687436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.688192 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.690014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.701211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1299/2642] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:23.705808 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.716462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9892bd-19db-4bfe-a353-b7589e6280f2 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.721911 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a5def-0737-45fc-9881-273799841433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.722592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5def-0737-45fc-9881-273799841433 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.722879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5def-0737-45fc-9881-273799841433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.723156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a5def-0737-45fc-9881-273799841433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.723892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a5def-0737-45fc-9881-273799841433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.725556 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007a5def-0737-45fc-9881-273799841433 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.736682 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1344/2643] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:23.741512 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.755572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aef0b-872f-4816-bd07-1fc92085da0b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.761029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.761959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.762240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.762522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] PATH_INFO: `/v3/projects/43894fe55e3346ebb33aafffc79b9a40/users/2f74c634ed8948d98227a58d9501a52c/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.779329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43894fe55e3346ebb33aafffc79b9a40, user_id=2f74c634ed8948d98227a58d9501a52c, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.783463 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:23.798679 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1300/2644] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:23 2022] PUT /identity/v3/projects/43894fe55e3346ebb33aafffc79b9a40/users/2f74c634ed8948d98227a58d9501a52c/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:23.809799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.810088 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.810370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.837389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] MFA Rules not processed for user `2f74c634ed8948d98227a58d9501a52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:23.838625 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:23.904042 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1345/2645] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:23.910661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:23.977924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f63b3-7cdc-4ba4-a076-60a766f0504e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:23.983032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:23.983696 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:23.983976 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:23.984250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:23.984937 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:23.987128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.017249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1301/2646] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:23 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:24.024275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.040896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5484af-615b-467c-a22f-c037b07f6f9d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.087258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:24.111589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.112297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.112581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.112856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.113608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.115552 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.138852 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1346/2647] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:24 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:24.143879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.160891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cd860-9584-41c5-8978-892eeb62903d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.168253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.169181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.169607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.170034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.171179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.173567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.184556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1302/2648] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:24.189190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.200062 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f169d-756b-480e-bbc4-338be0655e27 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.206169 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.207091 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.207363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.207658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] PATH_INFO: `/v3/projects/2f6f466a44bd463cb5f55e5c85c81012/users/ca013199f92a4eb99942c0b7b1c518c1/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.224727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6f466a44bd463cb5f55e5c85c81012, user_id=ca013199f92a4eb99942c0b7b1c518c1, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.227444 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.245392 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1347/2649] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:24 2022] PUT /identity/v3/projects/2f6f466a44bd463cb5f55e5c85c81012/users/ca013199f92a4eb99942c0b7b1c518c1/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:24.249672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.261046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ce777-e304-41fe-8068-35adf7dc1dd2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.295404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:24.323883 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181e1d2-4025-4829-bbbc-fb31653101bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.324563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181e1d2-4025-4829-bbbc-fb31653101bf admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.324839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181e1d2-4025-4829-bbbc-fb31653101bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.325109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181e1d2-4025-4829-bbbc-fb31653101bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.325878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181e1d2-4025-4829-bbbc-fb31653101bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.327472 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181e1d2-4025-4829-bbbc-fb31653101bf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.338668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1303/2650] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:24.342929 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.354228 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fadd9-1ca1-49fe-8de3-3b69ee70258b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.360022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.361019 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.361362 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.361643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] PATH_INFO: `/v3/projects/2f6f466a44bd463cb5f55e5c85c81012/users/ca013199f92a4eb99942c0b7b1c518c1/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.363909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6f466a44bd463cb5f55e5c85c81012, user_id=ca013199f92a4eb99942c0b7b1c518c1, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.366667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.378537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1348/2651] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:24 2022] PUT /identity/v3/projects/2f6f466a44bd463cb5f55e5c85c81012/users/ca013199f92a4eb99942c0b7b1c518c1/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:24.388905 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.389202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.389507 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.419094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] MFA Rules not processed for user `ca013199f92a4eb99942c0b7b1c518c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:24.420342 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:24.494927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1304/2652] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:24.506895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.508685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:24.572786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69277a7b-d86a-4c00-be7a-64568fc0602f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.576736 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.577221 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.577509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.577789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.589046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.590545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.602805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1349/2653] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:24.679144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:24.680630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:24.694221 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff616d2-7bd3-4504-87ac-f8baaf5af184 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:24.698120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef6a69-b066-4de4-9a4b-a73a57c7d097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:24.698789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef6a69-b066-4de4-9a4b-a73a57c7d097 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:24.699073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef6a69-b066-4de4-9a4b-a73a57c7d097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:24.699347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef6a69-b066-4de4-9a4b-a73a57c7d097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:24.758843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef6a69-b066-4de4-9a4b-a73a57c7d097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:24.760837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef6a69-b066-4de4-9a4b-a73a57c7d097 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:24.773228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1305/2654] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:25.065470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:25.135194 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd10aa-87cb-4355-92f0-1af584496bcf service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:25.139937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:25.140807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:25.141080 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:25.141379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] PATH_INFO: `/v3/users/2f74c634ed8948d98227a58d9501a52c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:25.142597 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f74c634ed8948d98227a58d9501a52c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:25.144567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:25.197081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:25.203910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f74c634ed8948d98227a58d9501a52c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.214366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f74c634ed8948d98227a58d9501a52c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.215027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f74c634ed8948d98227a58d9501a52c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.227590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f74c634ed8948d98227a58d9501a52c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.235318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f74c634ed8948d98227a58d9501a52c'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.242070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1350/2655] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:25 2022] DELETE /identity/v3/users/2f74c634ed8948d98227a58d9501a52c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:25.247404 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:25.247919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:25.248402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:25.268481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:25.269733 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:25.330560 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=100 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:25.344378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1306/2656] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:25.354770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:25.356448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:25.418048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6dc48-d877-4970-90cf-17926f80eb10 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:25.423375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:25.424941 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:25.425379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:25.425769 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:25.441193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:25.442737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:25.453460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1351/2657] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:25.746382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:25.747862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:25.752515 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:25.754345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:25.762223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c893e1-1d30-47b5-a31c-a351cd5b61a6 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:25.767911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:25.768498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:25.768870 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:25.769287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] PATH_INFO: `/v3/projects/43894fe55e3346ebb33aafffc79b9a40` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:25.770444 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43894fe55e3346ebb33aafffc79b9a40)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:25.773070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:25.819284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8054a59-8358-4bc2-a252-a6b0eed74a57 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:25.830714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43894fe55e3346ebb33aafffc79b9a40', 'request_id': 'req-5bedf556-3c8a-485c-9de0-272cbe616e69'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.839685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43894fe55e3346ebb33aafffc79b9a40', 'request_id': 'req-5bedf556-3c8a-485c-9de0-272cbe616e69'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.846831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43894fe55e3346ebb33aafffc79b9a40', 'request_id': 'req-5bedf556-3c8a-485c-9de0-272cbe616e69'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.858076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] The token cache is being invalidate because project 43894fe55e3346ebb33aafffc79b9a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:25.858278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.858947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:25.860505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1307/2658] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:25 2022] DELETE /identity/v3/projects/43894fe55e3346ebb33aafffc79b9a40 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:25.871388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:25.871388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:25.882000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:25.882757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:25.883102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:25.883466 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:25.889013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:25.920908 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:25.942316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf556-3c8a-485c-9de0-272cbe616e69 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:25.947076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:25.947964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:25.948248 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:25.948598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] PATH_INFO: `/v3/users/ca013199f92a4eb99942c0b7b1c518c1` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:25.949770 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca013199f92a4eb99942c0b7b1c518c1)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:25.951701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:25.955748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:25.957394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:25.967279 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1352/2659] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:25.999759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca013199f92a4eb99942c0b7b1c518c1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.008091 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca013199f92a4eb99942c0b7b1c518c1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.015326 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca013199f92a4eb99942c0b7b1c518c1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.015998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca013199f92a4eb99942c0b7b1c518c1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.027816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:26.030202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-df40cb0d-4d37-4314-a9ad-702a2e3350aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca013199f92a4eb99942c0b7b1c518c1'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.038831 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1308/2660] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:25 2022] DELETE /identity/v3/users/ca013199f92a4eb99942c0b7b1c518c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:26.331343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:26.347206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601510f9-2cb2-459f-bbcd-5f60543eb4da service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:26.408894 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:26.409806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.410085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.410358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] PATH_INFO: `/v3/projects/2f6f466a44bd463cb5f55e5c85c81012` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.411546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6f466a44bd463cb5f55e5c85c81012)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:26.413493 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:26.472039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6f466a44bd463cb5f55e5c85c81012', 'request_id': 'req-9bb6608b-6594-4e2e-8718-e5587ab91a3e'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.477762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6f466a44bd463cb5f55e5c85c81012', 'request_id': 'req-9bb6608b-6594-4e2e-8718-e5587ab91a3e'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.484017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6f466a44bd463cb5f55e5c85c81012', 'request_id': 'req-9bb6608b-6594-4e2e-8718-e5587ab91a3e'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.502837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] The token cache is being invalidate because project 2f6f466a44bd463cb5f55e5c85c81012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:26.503127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.504031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-9bb6608b-6594-4e2e-8718-e5587ab91a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:26.506177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1353/2661] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:26 2022] DELETE /identity/v3/projects/2f6f466a44bd463cb5f55e5c85c81012 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:26.511452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.511838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.512153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.533405 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:26.535282 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:26.599364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1309/2662] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:26.669703 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.670115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.670531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.693924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:26.695156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:26.704468 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1354/2663] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:26.709056 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:26.719308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1459de-017e-4449-abd7-a78269b3d681 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:26.724935 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:26.725951 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.726345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.726718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.727796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:26.728234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:26.730208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:26.748062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1310/2664] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:23:26.752816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:26.762667 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ed958-1f4f-4dda-9d3b-b246812528e6 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:26.768007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:26.768756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.769040 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.769337 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.770049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:26.771975 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:26.808548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1355/2665] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:26 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:26.814825 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:26.825219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605b468-263f-40a4-8ee3-cee838cd1b60 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:26.888500 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:26.889538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.889847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.890170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.891065 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:26.894080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:26.928388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1311/2666] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:26 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:26.933498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:26.947174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e60f0f-e7aa-402c-bc2b-d1fa0cf621e8 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:26.952002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:26.952679 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.952986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.953258 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.954067 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:26.956177 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:26.967326 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1356/2667] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:26.972284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:26.982571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d9d83-a3d3-443f-adc4-9275f45c6d31 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:26.988455 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e955c-d8af-42bf-b733-85dd5e62fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:26.989132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e955c-d8af-42bf-b733-85dd5e62fe46 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:26.989468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e955c-d8af-42bf-b733-85dd5e62fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:26.989756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e955c-d8af-42bf-b733-85dd5e62fe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:26.990513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e955c-d8af-42bf-b733-85dd5e62fe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:26.992152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e955c-d8af-42bf-b733-85dd5e62fe46 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:27.003916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1312/2668] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:27.008253 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:27.019756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe6224-c0d3-460a-ba11-2b170850b0d9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:27.024873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:27.025807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:27.026083 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:27.026716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] PATH_INFO: `/v3/projects/3aa7d1d0d2284a18b1625aafe803d68c/users/e7abb08da6974aada80bf8fcfbfcd932/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:27.042646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa7d1d0d2284a18b1625aafe803d68c, user_id=e7abb08da6974aada80bf8fcfbfcd932, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:27.045353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:27.047653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:27.062877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1357/2669] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:27 2022] PUT /identity/v3/projects/3aa7d1d0d2284a18b1625aafe803d68c/users/e7abb08da6974aada80bf8fcfbfcd932/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:27.074032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:27.074456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:27.074828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:27.113811 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] MFA Rules not processed for user `e7abb08da6974aada80bf8fcfbfcd932`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:27.115048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:27.167467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:27.186852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1313/2670] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:27.198395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:27.200559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:27.270986 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1334a-fe99-41d6-8f17-6758792d9dc4 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:27.275448 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcc880-aac6-45bc-b568-e41159445784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:27.276128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcc880-aac6-45bc-b568-e41159445784 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:27.276768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcc880-aac6-45bc-b568-e41159445784 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:27.277046 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcc880-aac6-45bc-b568-e41159445784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:27.286395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcc880-aac6-45bc-b568-e41159445784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:27.287868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcc880-aac6-45bc-b568-e41159445784 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:27.297962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1358/2671] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:30.918267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:30.920737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:31.015311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b48748-00dd-425d-ad85-1fb83fd56bec None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:31.021413 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:31.022316 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:31.022595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:31.022871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] PATH_INFO: `/v3/users/d6f2371f3297461eb69c651d61202579` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:31.024123 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f2371f3297461eb69c651d61202579)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:31.026104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:31.080443 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f2371f3297461eb69c651d61202579'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.090893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f2371f3297461eb69c651d61202579'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.101137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f2371f3297461eb69c651d61202579'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.102001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f2371f3297461eb69c651d61202579'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.118163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f2371f3297461eb69c651d61202579'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.124229 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1314/2672] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:30 2022] DELETE /identity/v3/users/d6f2371f3297461eb69c651d61202579 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:31.128931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:31.129924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:31.129924 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:31.148387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:31.149644 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:31.214137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1359/2673] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:31.225242 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:31.226953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:31.296529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3edca-2729-4fd0-aab6-2eb95dd913f9 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:31.301478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:31.302154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:31.302438 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:31.302716 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:31.314103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:31.316605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:31.332360 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1315/2674] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:31.640013 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:31.642857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:31.664347 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26098fe1-b20c-47f5-97c6-010a954d958f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:31.669449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:31.670364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:31.670646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:31.670922 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] PATH_INFO: `/v3/projects/e1a2dacc83ae49559784a7c7691d8098` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:31.672420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a2dacc83ae49559784a7c7691d8098)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:31.674445 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:31.732290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a2dacc83ae49559784a7c7691d8098', 'request_id': 'req-71df0e0f-c24b-40a0-975e-31a69ca57c6f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.739843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a2dacc83ae49559784a7c7691d8098', 'request_id': 'req-71df0e0f-c24b-40a0-975e-31a69ca57c6f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.746777 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a2dacc83ae49559784a7c7691d8098', 'request_id': 'req-71df0e0f-c24b-40a0-975e-31a69ca57c6f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.761007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] The token cache is being invalidate because project e1a2dacc83ae49559784a7c7691d8098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:31.761296 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.762952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.764616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1360/2675] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:31 2022] DELETE /identity/v3/projects/e1a2dacc83ae49559784a7c7691d8098 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:31.769860 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:31.780284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e732ba2-81f0-4e24-8b72-caf301372bdd service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:31.790605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:31.848324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:31.849228 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:31.849658 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:31.849804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] PATH_INFO: `/v3/users/22a1d1cd725b45a4bfe513be157302f4` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:31.851253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a1d1cd725b45a4bfe513be157302f4)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:31.853222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:31.900915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a1d1cd725b45a4bfe513be157302f4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.910468 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a1d1cd725b45a4bfe513be157302f4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.918278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a1d1cd725b45a4bfe513be157302f4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.918955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a1d1cd725b45a4bfe513be157302f4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.932033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5641c3ba-9112-44ec-8b27-a0dbf987fb7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a1d1cd725b45a4bfe513be157302f4'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:31.938308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1316/2676] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:31 2022] DELETE /identity/v3/users/22a1d1cd725b45a4bfe513be157302f4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:32.264582 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.266460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:32.294339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0e0f-c24b-40a0-975e-31a69ca57c6f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.332425 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:32.400449 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.401828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.402107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.402382 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] PATH_INFO: `/v3/projects/cc817692259b49d7bb24310d92854149` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.403650 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc817692259b49d7bb24310d92854149)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.405587 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.466154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc817692259b49d7bb24310d92854149', 'request_id': 'req-57eca99b-2245-484c-b774-06f2338b4283'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:32.474060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc817692259b49d7bb24310d92854149', 'request_id': 'req-57eca99b-2245-484c-b774-06f2338b4283'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:32.480954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc817692259b49d7bb24310d92854149', 'request_id': 'req-57eca99b-2245-484c-b774-06f2338b4283'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:32.494670 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] The token cache is being invalidate because project cc817692259b49d7bb24310d92854149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:32.494943 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:32.495604 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-57eca99b-2245-484c-b774-06f2338b4283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:32.497215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1361/2677] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:32 2022] DELETE /identity/v3/projects/cc817692259b49d7bb24310d92854149 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:32.503372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.504240 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.504619 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.523504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:32.524706 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:32.590843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1317/2678] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:32.599451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.599744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.600029 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.618417 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:32.619903 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:32.628199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1362/2679] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:32.632654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.642620 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa7f5-adc3-4982-9c6f-4b541db80ed7 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.648075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.648734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.649013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.649303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.650073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:32.650363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.652372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.665272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1318/2680] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:32.669952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.679789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d4dca-05d2-46d6-a1f6-db72d0c24e57 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.684418 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.685082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.685394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.685692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.686419 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.688339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.724311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1363/2681] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:32 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:32.725691 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.736587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d9403-bb3d-438f-a2b3-1d226e7bd817 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.756440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:32.801673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.802356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.802639 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.802916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.803606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.805579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.827204 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1319/2682] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:32 2022] POST /identity/v3/users => generated 280 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:32.831472 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.845566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bdcef-8cc1-4e35-b3ba-6f413a895eb9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.848174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.848869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.849151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.849454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.850193 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.851802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.864969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1364/2683] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:32.869081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.880165 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1c84f-4e29-4cc4-ab18-141bf50505ee admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.885278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2907933-4518-49ed-83d0-66fbaefeb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.885979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907933-4518-49ed-83d0-66fbaefeb3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.886259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907933-4518-49ed-83d0-66fbaefeb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.886543 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2907933-4518-49ed-83d0-66fbaefeb3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.887264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2907933-4518-49ed-83d0-66fbaefeb3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.888884 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2907933-4518-49ed-83d0-66fbaefeb3bf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.900861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1320/2684] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:32.904584 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:32.915483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b70f45-acbf-4c1e-81e3-05175daeafeb admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:32.927787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:32.927787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.927787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.927787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] PATH_INFO: `/v3/projects/ce86837cf01e46809ddb6b5c8f55a5dc/users/c48e9cb3210049d2a1bf2ecb71014b2d/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:32.944421 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce86837cf01e46809ddb6b5c8f55a5dc, user_id=c48e9cb3210049d2a1bf2ecb71014b2d, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:32.947240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:32.961143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1365/2685] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:32 2022] PUT /identity/v3/projects/ce86837cf01e46809ddb6b5c8f55a5dc/users/c48e9cb3210049d2a1bf2ecb71014b2d/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:32.973617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:32.974484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:32.974484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:33.005845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] MFA Rules not processed for user `c48e9cb3210049d2a1bf2ecb71014b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:33.007153 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:33.088284 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1321/2686] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:32 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:33.120089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:33.122026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:33.183352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:33.195156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bebc6-ffff-4895-bdae-4c189873a948 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:33.200447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622bf07-05ad-46a2-ab88-d4ba9b7ac135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:33.201117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622bf07-05ad-46a2-ab88-d4ba9b7ac135 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:33.201437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622bf07-05ad-46a2-ab88-d4ba9b7ac135 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:33.201719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622bf07-05ad-46a2-ab88-d4ba9b7ac135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:33.212348 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622bf07-05ad-46a2-ab88-d4ba9b7ac135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:33.213868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622bf07-05ad-46a2-ab88-d4ba9b7ac135 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:33.224764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1366/2687] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:33 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:33.242351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:33.318163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878c2e-fe84-4d14-b206-0af7f6ead601 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:33.323838 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:33.324977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:33.325304 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:33.329534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] PATH_INFO: `/v3/users/c48e9cb3210049d2a1bf2ecb71014b2d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:33.330981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48e9cb3210049d2a1bf2ecb71014b2d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:33.332998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:33.371618 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:33.392382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48e9cb3210049d2a1bf2ecb71014b2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:33.421739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48e9cb3210049d2a1bf2ecb71014b2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:33.430062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48e9cb3210049d2a1bf2ecb71014b2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:33.431086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48e9cb3210049d2a1bf2ecb71014b2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:33.445344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48e9cb3210049d2a1bf2ecb71014b2d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:33.452391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1322/2688] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:33 2022] DELETE /identity/v3/users/c48e9cb3210049d2a1bf2ecb71014b2d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:33.457366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:33.458023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:33.458023 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:33.475606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:33.476839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:33.544475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1367/2689] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:33.554865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:33.556446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:33.627082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2a488-293b-436b-b073-026d92842a45 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:33.632148 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e60442-e35d-4e24-ba7e-9e0ff6721a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:33.632900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60442-e35d-4e24-ba7e-9e0ff6721a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:33.633255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60442-e35d-4e24-ba7e-9e0ff6721a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:33.633855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e60442-e35d-4e24-ba7e-9e0ff6721a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:33.644223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e60442-e35d-4e24-ba7e-9e0ff6721a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:33.646433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e60442-e35d-4e24-ba7e-9e0ff6721a66 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:33.657692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1323/2690] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:33.974993 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:33.976900 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:33.990140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141319c-9ebc-40f1-ba17-cc70b9e873ea None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:33.996366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:33.997303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:33.997622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:33.997893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] PATH_INFO: `/v3/projects/ce86837cf01e46809ddb6b5c8f55a5dc` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:33.999166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce86837cf01e46809ddb6b5c8f55a5dc)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.001102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.055807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce86837cf01e46809ddb6b5c8f55a5dc', 'request_id': 'req-5dc55a12-5012-4a29-b016-fc7ddc48fe97'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:34.061361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce86837cf01e46809ddb6b5c8f55a5dc', 'request_id': 'req-5dc55a12-5012-4a29-b016-fc7ddc48fe97'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:34.068361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce86837cf01e46809ddb6b5c8f55a5dc', 'request_id': 'req-5dc55a12-5012-4a29-b016-fc7ddc48fe97'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:34.083781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] The token cache is being invalidate because project ce86837cf01e46809ddb6b5c8f55a5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:34.084230 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:34.085542 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5dc55a12-5012-4a29-b016-fc7ddc48fe97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:34.086771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1368/2691] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:33 2022] DELETE /identity/v3/projects/ce86837cf01e46809ddb6b5c8f55a5dc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:34.091845 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.092381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.092381 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.111861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:34.113122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:34.180807 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1324/2692] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:34.189069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.189366 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.189743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.209872 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:34.211214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:34.221628 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1369/2693] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:34.226801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.238449 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a563d85-c464-4074-85bd-4e7abfdf4bcf None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.244231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.245077 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.245362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.245663 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.246464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:34.246783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.248415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.262051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1325/2694] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:34.267138 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.278573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c35ab3-6a0a-41fb-a8ac-dcc03dcd1065 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.284407 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.285217 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.285638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.285944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.286816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.289237 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.319881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1370/2695] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:34 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:34.324160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.335506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89211089-dc53-40ac-8cdc-b6db99b02bab admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.372453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:34.399621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.400308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.400590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.400863 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.401960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.403881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.426754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1326/2696] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:34 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:34.431160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.441995 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185d66-8424-4278-8259-193c358719e1 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.446802 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.447487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.447770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.448048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.448792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.450463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.462632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1371/2697] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:34.467498 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.479224 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcffab-ea20-4d92-932b-e36816a55104 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.484236 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f596259-deab-4f0f-af4a-f1cc9fd0257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.484916 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596259-deab-4f0f-af4a-f1cc9fd0257d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.485195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596259-deab-4f0f-af4a-f1cc9fd0257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.485645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f596259-deab-4f0f-af4a-f1cc9fd0257d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.486383 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f596259-deab-4f0f-af4a-f1cc9fd0257d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.487988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f596259-deab-4f0f-af4a-f1cc9fd0257d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.499956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1327/2698] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:34.504561 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.515202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6584e-e12f-47b2-9a5b-606da17f793f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.520781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.521735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.522006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.522288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] PATH_INFO: `/v3/projects/9b3d03649bec48d2a252e8024bb367ec/users/f58fec82ee1b451a87d034508cd71216/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.540622 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3d03649bec48d2a252e8024bb367ec, user_id=f58fec82ee1b451a87d034508cd71216, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.543404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.559557 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1372/2699] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:34 2022] PUT /identity/v3/projects/9b3d03649bec48d2a252e8024bb367ec/users/f58fec82ee1b451a87d034508cd71216/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:34.572576 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.573032 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.573387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.606436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] MFA Rules not processed for user `f58fec82ee1b451a87d034508cd71216`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:34.607661 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:34.699662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1328/2700] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:34.708998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:34.712463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:34.730157 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:34.834163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee46dd2-9c5e-4925-8f31-4fedf883614c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:34.838743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f482459-2317-41da-98d2-ba3bb461ddb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:34.840559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482459-2317-41da-98d2-ba3bb461ddb4 service glance] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:34.841109 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482459-2317-41da-98d2-ba3bb461ddb4 service glance] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:34.841608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482459-2317-41da-98d2-ba3bb461ddb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:34.853360 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f482459-2317-41da-98d2-ba3bb461ddb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:34.854838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f482459-2317-41da-98d2-ba3bb461ddb4 service glance] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:34.865760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1373/2701] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:37.422786 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:37.424384 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:37.511794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5632a-4de6-4f79-b85d-651002a4495b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:37.517475 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:37.518462 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:37.518642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:37.518939 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] PATH_INFO: `/v3/users/e7abb08da6974aada80bf8fcfbfcd932` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:37.520348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7abb08da6974aada80bf8fcfbfcd932)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:37.522311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:37.609544 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7abb08da6974aada80bf8fcfbfcd932'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:37.611556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:37.628425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7abb08da6974aada80bf8fcfbfcd932'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:37.637872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7abb08da6974aada80bf8fcfbfcd932'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:37.638830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7abb08da6974aada80bf8fcfbfcd932'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:37.667936 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7abb08da6974aada80bf8fcfbfcd932'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:37.677569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1329/2702] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:37 2022] DELETE /identity/v3/users/e7abb08da6974aada80bf8fcfbfcd932 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:37.683133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:37.683836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:37.683836 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:37.717388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:37.718691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:37.824658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1374/2703] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:37.835857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:37.837768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:37.925053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297dfc2-e253-4e05-b2c6-02f684ead224 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:37.932944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29ae27-9b05-4be4-9fff-51e72b9999f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:37.933732 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ae27-9b05-4be4-9fff-51e72b9999f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:37.934193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ae27-9b05-4be4-9fff-51e72b9999f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:37.934489 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ae27-9b05-4be4-9fff-51e72b9999f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:37.945801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ae27-9b05-4be4-9fff-51e72b9999f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:37.947379 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ae27-9b05-4be4-9fff-51e72b9999f1 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:37.962215 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1330/2704] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:38.328143 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.330070 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:38.352651 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54186cf5-f6cc-4ec5-9b32-81e6e42ef6ad None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.359422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.360489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.360781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.361065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] PATH_INFO: `/v3/projects/3aa7d1d0d2284a18b1625aafe803d68c` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.362388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa7d1d0d2284a18b1625aafe803d68c)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:38.365890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:38.422691 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa7d1d0d2284a18b1625aafe803d68c', 'request_id': 'req-6ed0b98c-1c15-4024-ad11-a26de6755ad9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:38.430354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa7d1d0d2284a18b1625aafe803d68c', 'request_id': 'req-6ed0b98c-1c15-4024-ad11-a26de6755ad9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:38.436653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa7d1d0d2284a18b1625aafe803d68c', 'request_id': 'req-6ed0b98c-1c15-4024-ad11-a26de6755ad9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:38.451947 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] The token cache is being invalidate because project 3aa7d1d0d2284a18b1625aafe803d68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:38.452248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:38.452907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-6ed0b98c-1c15-4024-ad11-a26de6755ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:38.454590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1375/2705] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:38 2022] DELETE /identity/v3/projects/3aa7d1d0d2284a18b1625aafe803d68c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:38.460456 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.461206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.461206 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.479374 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:38.480606 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:38.553538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1331/2706] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:38.559175 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.559464 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.559746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.591172 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:38.593132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:38.620610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1376/2707] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:38.624865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.635237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf4783-b3c5-4654-9b79-b3fcfdab3d18 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.644051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.645912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.645912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.645912 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.646281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:38.646600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:38.648341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:38.664896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1332/2708] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:38.666073 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.675575 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94b24d-6b34-4f58-9119-ff8013753cca None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.682020 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.682707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.682982 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.683436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.684747 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:38.690354 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:38.724981 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1377/2709] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:38 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:38.732453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.740073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3a2ec-4375-4ae5-ae39-1cccc7ad6ab8 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.818774 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:38.828513 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.829689 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.830805 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.831008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.832175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:38.834502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:38.862275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1333/2710] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:38 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:38.866640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.878210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912ce0-5244-46e8-9159-176d56807de0 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.883756 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.884460 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.884744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.885077 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.886998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:38.889384 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:38.898719 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:38.910974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.911813 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1378/2711] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:38.923903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec2943-fe6a-4668-81cf-2bf3b1531a27 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.934348 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f1e8e-812e-46a6-a962-5277b01b99e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.935107 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f1e8e-812e-46a6-a962-5277b01b99e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.935393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f1e8e-812e-46a6-a962-5277b01b99e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.935671 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f1e8e-812e-46a6-a962-5277b01b99e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.936496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f1e8e-812e-46a6-a962-5277b01b99e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:38.938426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f1e8e-812e-46a6-a962-5277b01b99e8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:38.955431 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1334/2712] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:38.956327 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:38.973199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d875b20-efb8-4a97-b7a9-fedd168ec994 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:38.978477 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:38.979404 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:38.979685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:38.979962 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] PATH_INFO: `/v3/projects/0d141f1b8c984a5a9fbf2fb3c8f01b2b/users/0df0a42b2f2442e2a34b6538311212aa/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:38.997376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d141f1b8c984a5a9fbf2fb3c8f01b2b, user_id=0df0a42b2f2442e2a34b6538311212aa, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:39.000106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:39.024388 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1379/2713] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:38 2022] PUT /identity/v3/projects/0d141f1b8c984a5a9fbf2fb3c8f01b2b/users/0df0a42b2f2442e2a34b6538311212aa/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:39.030296 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:39.030422 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:39.030680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:39.049059 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:39.050569 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:39.137704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1335/2714] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:39.148216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:39.150385 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:39.218833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a05d42-2b8d-4692-843d-ada4b92089cc admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:39.224889 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2833c-8e18-40ce-96c1-d790bbcbc137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:39.225925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2833c-8e18-40ce-96c1-d790bbcbc137 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:39.226054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2833c-8e18-40ce-96c1-d790bbcbc137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:39.226394 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2833c-8e18-40ce-96c1-d790bbcbc137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:39.246125 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2833c-8e18-40ce-96c1-d790bbcbc137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:39.247730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2833c-8e18-40ce-96c1-d790bbcbc137 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:39.258215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1380/2715] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:42.245297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:42.246891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:42.271688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c8a3-6e78-42b5-aaa7-980fe67340ce None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:42.273799 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:42.274509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:42.274801 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:42.275178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:42.277659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:42.294974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:42.296521 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:42.314259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1336/2716] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:44.304920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740923f9-fbba-4397-a741-db9734b42261 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:44.305746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740923f9-fbba-4397-a741-db9734b42261 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:44.318268 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740923f9-fbba-4397-a741-db9734b42261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:44.358049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-740923f9-fbba-4397-a741-db9734b42261 None None] MFA Rules not processed for user `0df0a42b2f2442e2a34b6538311212aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:44.359093 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-740923f9-fbba-4397-a741-db9734b42261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:44.468376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1381/2717] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:44.473685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:44.485072 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084a279-85a1-480c-822d-8000c4b38c46 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:44.491508 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:44.492613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:44.493260 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:44.493700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:44.494549 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:44.497027 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:44.549439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1337/2718] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:44 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:44.553524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740923f9-fbba-4397-a741-db9734b42261 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:44.569817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740923f9-fbba-4397-a741-db9734b42261 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:44.653447 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:44.654229 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:44.654454 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:44.654733 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:44.655616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:44.657655 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:44.668339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:44.700577 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1382/2719] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:44 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:44.702280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:44.716901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e60d2-d28f-48c7-91ce-fe398ecde1c6 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:44.734071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:44.735865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:44.736502 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:44.736795 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:44.737752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:44.740104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:44.752938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1338/2720] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:44.757090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:44.775918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106bec4-009f-4d60-8dca-969e22aa6cbf admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:44.789251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:44.790594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:44.791064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:44.791558 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] PATH_INFO: `/v3/projects/58c17e29e47547019294543be70e1043/users/4c6bead4b60747729d8ae0de408dbe5d/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:44.821647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c17e29e47547019294543be70e1043, user_id=4c6bead4b60747729d8ae0de408dbe5d, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:44.826149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:44.849630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1383/2721] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:44 2022] PUT /identity/v3/projects/58c17e29e47547019294543be70e1043/users/4c6bead4b60747729d8ae0de408dbe5d/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:44.854417 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:44.916808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b76fc6-541f-4064-bb73-bb8c3d74059e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:45.052713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:45.054633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:45.055693 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:45.056141 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:45.058005 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:45.063075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:45.080496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1339/2722] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:45.081921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:45.100396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78872f3-9ce8-4b74-806d-13aaa5ef4c97 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:45.116915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:45.118069 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:45.118455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:45.120181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] PATH_INFO: `/v3/projects/58c17e29e47547019294543be70e1043/users/4c6bead4b60747729d8ae0de408dbe5d/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:45.130092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c17e29e47547019294543be70e1043, user_id=4c6bead4b60747729d8ae0de408dbe5d, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:45.137133 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:45.168907 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1384/2723] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:45 2022] PUT /identity/v3/projects/58c17e29e47547019294543be70e1043/users/4c6bead4b60747729d8ae0de408dbe5d/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:46.867794 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:46.869749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:46.889979 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d9fcf-2956-4651-a1fd-9f1fc632be5f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:46.928341 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:47.014817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:47.016140 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:47.016810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:47.017352 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] PATH_INFO: `/v3/users/97aa07a49016448d9b1067ce0dbd8d99` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:47.020017 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97aa07a49016448d9b1067ce0dbd8d99)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:47.024266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:47.157219 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97aa07a49016448d9b1067ce0dbd8d99'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.170278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97aa07a49016448d9b1067ce0dbd8d99'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.183525 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97aa07a49016448d9b1067ce0dbd8d99'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.184540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97aa07a49016448d9b1067ce0dbd8d99'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.203746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-bb53dac2-0162-4411-969a-c3d6dc0a13d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97aa07a49016448d9b1067ce0dbd8d99'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.236057 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1340/2724] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:46 2022] DELETE /identity/v3/users/97aa07a49016448d9b1067ce0dbd8d99 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:47.585144 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:47.587796 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:47.604896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6527f913-9e90-4f90-9967-a4599fa95807 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:47.690614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:47.694648 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:47.695099 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:47.695710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] PATH_INFO: `/v3/projects/1593797d34a04b169379da1a51e18072` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:47.699492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1593797d34a04b169379da1a51e18072)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:47.703623 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:47.786871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1593797d34a04b169379da1a51e18072', 'request_id': 'req-76166e81-c658-4e56-b6e4-db7903d97543'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.796359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1593797d34a04b169379da1a51e18072', 'request_id': 'req-76166e81-c658-4e56-b6e4-db7903d97543'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.805427 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1593797d34a04b169379da1a51e18072', 'request_id': 'req-76166e81-c658-4e56-b6e4-db7903d97543'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.822699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] The token cache is being invalidate because project 1593797d34a04b169379da1a51e18072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:47.823855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.824997 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-76166e81-c658-4e56-b6e4-db7903d97543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:47.831349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1385/2725] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:47 2022] DELETE /identity/v3/projects/1593797d34a04b169379da1a51e18072 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:47.834131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:47.835208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:47.835611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:47.877932 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:47.879509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:48.005246 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1341/2726] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:48.015028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.015220 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.015441 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.046821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:48.048160 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:48.058642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1386/2727] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:48.063213 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.074526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2e3c7-0788-4e27-b86e-7f2c3999e96b None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.079138 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.079917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.080271 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.080614 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.081447 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:48.082019 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.083988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.099007 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1342/2728] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:48.104188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.117998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807172cc-1a69-4b3a-bd4d-a00f2de0080a None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.128869 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.132356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.133061 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.133826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.134559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.136734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.172549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1387/2729] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:48 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:48.177773 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.188173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc634c0e-66c8-42a2-a37d-8f03017393ea admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.221185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:48.264722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.265675 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.266106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.266382 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.267118 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.269122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.294966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1343/2730] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:48 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:48.299202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.313308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67d9ba-7864-480a-875d-9a2c6c09b505 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.321516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.322084 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.322440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.323188 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.323629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.325646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.341705 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1388/2731] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:48.345776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.367331 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1677-a23f-4c77-98f4-46c783943305 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.374767 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfc7e2-fa1b-4db5-bcf3-20dff191baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.375848 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc7e2-fa1b-4db5-bcf3-20dff191baf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.376197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc7e2-fa1b-4db5-bcf3-20dff191baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.376546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfc7e2-fa1b-4db5-bcf3-20dff191baf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.377425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc7e2-fa1b-4db5-bcf3-20dff191baf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.379710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfc7e2-fa1b-4db5-bcf3-20dff191baf8 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.394119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1344/2732] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:48.398890 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.419189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf1725-cffc-48aa-a11f-bd37f230d389 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.430957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.432921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.433563 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.434630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] PATH_INFO: `/v3/projects/96750881d717498ebd786f808eb22db0/users/15edc85e572046fb96107eb2bdc24409/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.439035 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:48.463309 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96750881d717498ebd786f808eb22db0, user_id=15edc85e572046fb96107eb2bdc24409, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.466306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.494843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1389/2733] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:48 2022] PUT /identity/v3/projects/96750881d717498ebd786f808eb22db0/users/15edc85e572046fb96107eb2bdc24409/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:48.497038 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.497534 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.498049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.570255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] MFA Rules not processed for user `15edc85e572046fb96107eb2bdc24409`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:48.577759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:48.721660 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1345/2734] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:48.723289 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.870855 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b37a9-9b0f-4c61-8e0f-b6f8e7094b9d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:48.886514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:48.887554 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:48.889127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:48.889647 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:48.890537 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:48.892823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:48.963393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1390/2735] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:48 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:48.968193 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:48.990832 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebd09b-1a79-4878-9e1f-044f20083e4f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:49.239740 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:49.246372 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:49.247071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:49.247566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:49.248345 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:49.250433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:49.304230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1346/2736] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:48 2022] POST /identity/v3/users => generated 296 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:49.305599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:49.322282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def6232-cb05-4432-9777-dafa3896a0a5 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:49.331782 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:49.333254 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:49.333553 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:49.333839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:49.334603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:49.336969 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:49.352593 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1391/2737] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:49.355273 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:49.371060 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec623d-58bc-4df3-b2ee-3da5d95fddfe admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:49.383015 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:49.384368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:49.384910 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:49.385425 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] PATH_INFO: `/v3/projects/f2277310b44346629e4eac4682ba59af/users/2c17da3359cb414683189c82fb18172f/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:49.406553 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2277310b44346629e4eac4682ba59af, user_id=2c17da3359cb414683189c82fb18172f, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:49.411041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:49.432919 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1347/2738] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:49 2022] PUT /identity/v3/projects/f2277310b44346629e4eac4682ba59af/users/2c17da3359cb414683189c82fb18172f/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:23:49.437489 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:49.456119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb791a-2038-4600-850d-b0448d1c900b admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:49.555470 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2c7ee-3e5c-4c4b-bc5f-a346f114da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:49.556567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2c7ee-3e5c-4c4b-bc5f-a346f114da65 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:49.556984 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2c7ee-3e5c-4c4b-bc5f-a346f114da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:49.557422 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2c7ee-3e5c-4c4b-bc5f-a346f114da65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:49.558706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2c7ee-3e5c-4c4b-bc5f-a346f114da65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:49.561085 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2c7ee-3e5c-4c4b-bc5f-a346f114da65 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:49.579307 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1392/2739] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:49.579705 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:49.590478 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:49.597011 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14daf62-a916-456c-9c65-94161c33c673 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:49.607109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:49.608223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:49.608596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:49.608970 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] PATH_INFO: `/v3/projects/f2277310b44346629e4eac4682ba59af/users/2c17da3359cb414683189c82fb18172f/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:49.611688 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2277310b44346629e4eac4682ba59af, user_id=2c17da3359cb414683189c82fb18172f, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:49.615223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:49.647712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1348/2740] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:49 2022] PUT /identity/v3/projects/f2277310b44346629e4eac4682ba59af/users/2c17da3359cb414683189c82fb18172f/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:49.650471 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:49.650762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:49.651411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:49.687249 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] MFA Rules not processed for user `2c17da3359cb414683189c82fb18172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:49.689701 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:49.779671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:49.854158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1393/2741] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:49.864891 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:49.867170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:50.053585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f06df-68b7-41a9-8d74-6db813d34dc0 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:50.066878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5b84-5126-4e22-a4ea-7b6c922379b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:50.067841 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5b84-5126-4e22-a4ea-7b6c922379b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:50.068303 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5b84-5126-4e22-a4ea-7b6c922379b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:50.069024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5b84-5126-4e22-a4ea-7b6c922379b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:50.094423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef5b84-5126-4e22-a4ea-7b6c922379b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:50.096746 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef5b84-5126-4e22-a4ea-7b6c922379b7 service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:50.119842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1349/2742] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:50.277209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:50.296991 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536032b-a82e-460b-be30-4167ab94a2b7 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:50.309369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:50.310078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:50.310363 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:50.310649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:50.468004 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:50.469758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:50.484275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1394/2743] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:51.484742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fbff8-a76a-437a-88f3-33e5411666a1 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:51.485524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fbff8-a76a-437a-88f3-33e5411666a1 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:51.485524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fbff8-a76a-437a-88f3-33e5411666a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:51.524804 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d87fbff8-a76a-437a-88f3-33e5411666a1 None None] MFA Rules not processed for user `4c6bead4b60747729d8ae0de408dbe5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:51.526523 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d87fbff8-a76a-437a-88f3-33e5411666a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:51.652947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1350/2744] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:51.667702 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:51.670065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:51.743713 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ea8d-8068-473c-a147-e8fca2568b00 service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:51.748393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6a0960c6d4a497fbd2761d46689fdb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:51.749155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:51.749685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:51.750015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:51.752764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:51.844669 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:51.846207 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:51.857588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1395/2745] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:51.966081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:51.966505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:51.966656 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:51.986427 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:51.987641 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:52.045750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1351/2746] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:23:52.075119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:52.076761 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:52.119526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:52.162795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8752aef-5e98-4042-a942-fec8c97af475 service glance] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:52.167978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df958b4-0b53-4ec2-aa21-4abd29b7d54c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:52.168658 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df958b4-0b53-4ec2-aa21-4abd29b7d54c service swift] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:52.168944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df958b4-0b53-4ec2-aa21-4abd29b7d54c service swift] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:52.169212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df958b4-0b53-4ec2-aa21-4abd29b7d54c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:52.178512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df958b4-0b53-4ec2-aa21-4abd29b7d54c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:52.180109 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df958b4-0b53-4ec2-aa21-4abd29b7d54c service swift] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:52.194286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1396/2747] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:23:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:23:53.419930 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:53.467968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:53.564877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5a348-4725-4dc0-b59f-4b9b4dbac5dd None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:53.582387 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:53.586044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:53.586351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:53.586630 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] PATH_INFO: `/v3/users/15edc85e572046fb96107eb2bdc24409` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:53.590186 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15edc85e572046fb96107eb2bdc24409)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:53.599174 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:53.671575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15edc85e572046fb96107eb2bdc24409'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:53.690505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15edc85e572046fb96107eb2bdc24409'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:53.700990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15edc85e572046fb96107eb2bdc24409'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:53.703173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15edc85e572046fb96107eb2bdc24409'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:53.728173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15edc85e572046fb96107eb2bdc24409'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:53.739609 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1352/2748] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:53 2022] DELETE /identity/v3/users/15edc85e572046fb96107eb2bdc24409 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:53.744412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:53.745270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:53.745270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:53.766089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:53.767671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:53.857534 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1397/2749] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:53.867202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:53.868700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:53.959785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4f5f-b0c6-42a6-893b-0dd0c1a3dd6b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:53.969044 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:53.969842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:53.970274 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:53.970889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:53.996205 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:53.999726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:54.018486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1353/2750] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:54.549044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:54.550892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:54.588803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333183b-fd3a-4f11-be1a-308f0f8432f5 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:54.608054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:54.609267 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:54.609795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:54.610282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] PATH_INFO: `/v3/projects/96750881d717498ebd786f808eb22db0` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:54.612098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=96750881d717498ebd786f808eb22db0)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:54.615566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:54.755389 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96750881d717498ebd786f808eb22db0', 'request_id': 'req-c0ebdec3-ed42-402b-aa56-76672cbe3cae'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:54.772007 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96750881d717498ebd786f808eb22db0', 'request_id': 'req-c0ebdec3-ed42-402b-aa56-76672cbe3cae'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:54.786818 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96750881d717498ebd786f808eb22db0', 'request_id': 'req-c0ebdec3-ed42-402b-aa56-76672cbe3cae'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:54.817079 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] The token cache is being invalidate because project 96750881d717498ebd786f808eb22db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:54.817545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:54.818352 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:54.821509 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1398/2751] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:54 2022] DELETE /identity/v3/projects/96750881d717498ebd786f808eb22db0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:54.825758 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:54.840829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c65f7d-44d3-41fd-ad5d-1c63163313d3 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:54.967749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:55.009969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:55.011531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:55.011531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:55.011531 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] PATH_INFO: `/v3/users/2c17da3359cb414683189c82fb18172f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:55.014497 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c17da3359cb414683189c82fb18172f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:55.016683 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:55.157722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c17da3359cb414683189c82fb18172f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.191581 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c17da3359cb414683189c82fb18172f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.209020 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c17da3359cb414683189c82fb18172f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.210073 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c17da3359cb414683189c82fb18172f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.261047 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-ac9d3889-3f06-427b-bf8a-0972994c4e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c17da3359cb414683189c82fb18172f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.274393 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1354/2752] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:54 2022] DELETE /identity/v3/users/2c17da3359cb414683189c82fb18172f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:55.667458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:55.673919 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:55.691429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebdec3-ed42-402b-aa56-76672cbe3cae admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:55.782132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:55.802684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:55.807893 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:55.808356 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:55.808935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] PATH_INFO: `/v3/projects/f2277310b44346629e4eac4682ba59af` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:55.811038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2277310b44346629e4eac4682ba59af)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:55.813431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:55.885121 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2277310b44346629e4eac4682ba59af', 'request_id': 'req-0a90d81f-904e-4a29-bc72-b499485530a9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.897420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2277310b44346629e4eac4682ba59af', 'request_id': 'req-0a90d81f-904e-4a29-bc72-b499485530a9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.911459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2277310b44346629e4eac4682ba59af', 'request_id': 'req-0a90d81f-904e-4a29-bc72-b499485530a9'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.930753 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] The token cache is being invalidate because project f2277310b44346629e4eac4682ba59af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:55.931357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.932195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0a90d81f-904e-4a29-bc72-b499485530a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:55.936946 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1399/2753] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:55 2022] DELETE /identity/v3/projects/f2277310b44346629e4eac4682ba59af => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:55.941858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:55.943083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:55.949707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:55.977464 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:55.978752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:56.096113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1355/2754] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:56.107096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.107409 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.107692 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.142783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:56.144411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:56.157197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1400/2755] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:56.158076 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.170084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726bfed-a062-4a63-b04c-f7546874e385 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.174925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.175700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.175978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.176253 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.176988 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:56.177295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.179104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.194158 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1356/2756] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:23:56.198300 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.217096 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95430a-0c85-4b50-b0a3-a4e6f03a2985 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.244891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.246116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.246469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.246807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.247882 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.250632 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.303339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1401/2757] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:56 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:56.308592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.329862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596a277-dcff-42e9-ab3f-2dfa5291b462 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.400198 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:56.414983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.416000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.416607 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.417125 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.418081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.420726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.451251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1357/2758] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:56 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:56.456008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.469174 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854b29f-484e-461c-9888-47fad12ed8f3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.474576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.475434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.475831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.475998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.476771 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.478428 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.493619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1402/2759] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:56.498082 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.520496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c4a32-1e44-4767-9e4f-7e605cf58a12 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.526539 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62410-63f6-4a00-b740-c2e07b534080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.527749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62410-63f6-4a00-b740-c2e07b534080 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.528175 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62410-63f6-4a00-b740-c2e07b534080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.528616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62410-63f6-4a00-b740-c2e07b534080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.529765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62410-63f6-4a00-b740-c2e07b534080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.531664 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62410-63f6-4a00-b740-c2e07b534080 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.547759 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1358/2760] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:56.551978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.566197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d0f5d-4de6-4fa8-94a6-35ca71840628 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.573210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.574294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.574672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.575047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] PATH_INFO: `/v3/projects/3cbd3b993beb4b068fcb65c362e01ea9/users/a3a9cc0b546e45c4840e2e7bfea6958b/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.594883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbd3b993beb4b068fcb65c362e01ea9, user_id=a3a9cc0b546e45c4840e2e7bfea6958b, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.598010 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.623972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1403/2761] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:56 2022] PUT /identity/v3/projects/3cbd3b993beb4b068fcb65c362e01ea9/users/a3a9cc0b546e45c4840e2e7bfea6958b/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:56.628280 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.628769 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.629163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.661984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] MFA Rules not processed for user `a3a9cc0b546e45c4840e2e7bfea6958b`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:56.663209 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:56.761878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1359/2762] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:56.777301 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.779215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:56.871107 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ddce24-866d-422f-8811-ad5cdc128b13 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:56.875334 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2cae4-b39f-4df4-b01b-f5ad44498641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:56.876199 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2cae4-b39f-4df4-b01b-f5ad44498641 service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:56.876640 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2cae4-b39f-4df4-b01b-f5ad44498641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:56.877209 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2cae4-b39f-4df4-b01b-f5ad44498641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:56.888932 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2cae4-b39f-4df4-b01b-f5ad44498641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:56.890453 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2cae4-b39f-4df4-b01b-f5ad44498641 service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:56.903590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1404/2763] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:56.923573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:56.998185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25a55f-0491-4c6f-96e7-497efc28cd62 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:57.005965 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:57.007257 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:57.007698 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:57.008131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] PATH_INFO: `/v3/users/a3a9cc0b546e45c4840e2e7bfea6958b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:57.009655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a9cc0b546e45c4840e2e7bfea6958b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:57.011766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:57.100028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a9cc0b546e45c4840e2e7bfea6958b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.115160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a9cc0b546e45c4840e2e7bfea6958b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.130003 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a9cc0b546e45c4840e2e7bfea6958b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.130918 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a9cc0b546e45c4840e2e7bfea6958b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.132546 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:57.158328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a9cc0b546e45c4840e2e7bfea6958b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.167230 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1360/2764] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:23:56 2022] DELETE /identity/v3/users/a3a9cc0b546e45c4840e2e7bfea6958b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:57.171685 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:57.172189 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:57.172545 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:57.194255 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:57.195603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:57.220619 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:57.304265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1405/2765] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:57.317596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:57.319488 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:57.410566 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364cd02-3e45-4f26-a039-b6cb275fae25 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:57.414915 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686261d8-2ba1-4a00-8149-2f9aaa1c0fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:57.415971 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686261d8-2ba1-4a00-8149-2f9aaa1c0fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:57.416672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686261d8-2ba1-4a00-8149-2f9aaa1c0fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:57.416672 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686261d8-2ba1-4a00-8149-2f9aaa1c0fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:57.428466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686261d8-2ba1-4a00-8149-2f9aaa1c0fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:57.429966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686261d8-2ba1-4a00-8149-2f9aaa1c0fc6 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:57.442196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1361/2766] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:23:57.810497 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:57.812294 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:57.828058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00e09b-a17b-43ba-846f-6c18b433721f None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:57.839166 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:57.840265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:57.841103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:57.841450 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] PATH_INFO: `/v3/projects/3cbd3b993beb4b068fcb65c362e01ea9` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:57.843775 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cbd3b993beb4b068fcb65c362e01ea9)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:57.846478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:57.926284 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cbd3b993beb4b068fcb65c362e01ea9', 'request_id': 'req-4c2d98df-147a-4974-8cb8-5baf6ad016be'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.934000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cbd3b993beb4b068fcb65c362e01ea9', 'request_id': 'req-4c2d98df-147a-4974-8cb8-5baf6ad016be'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.941049 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cbd3b993beb4b068fcb65c362e01ea9', 'request_id': 'req-4c2d98df-147a-4974-8cb8-5baf6ad016be'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.961792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] The token cache is being invalidate because project 3cbd3b993beb4b068fcb65c362e01ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:23:57.962320 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.963017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-4c2d98df-147a-4974-8cb8-5baf6ad016be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:23:57.968495 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1406/2767] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:23:57 2022] DELETE /identity/v3/projects/3cbd3b993beb4b068fcb65c362e01ea9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:57.970561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:57.971556 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:57.971842 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:57.995083 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:57.996655 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:58.076654 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1362/2768] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:58.086240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.086643 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.087033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.115033 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:58.117931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:58.136555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1407/2769] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:58.137540 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.151853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f559e2c-968e-4607-a56b-71d3b8e6e86e None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.157302 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.157530 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.157722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.158222 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.158849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:23:58.159938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.161347 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.176040 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1363/2770] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:23:58.180475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.197001 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21707b20-797a-44b5-b453-a054bf64f090 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.202137 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.202743 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.203031 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.203316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.204152 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.206116 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.265550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1408/2771] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:23:58 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:23:58.269476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.301039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4af654-7e44-4656-8635-999de68a4d68 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.378917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.379714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.380097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.380486 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.381278 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.383332 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.402329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:58.413080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1364/2772] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:23:58 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:23:58.413853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.429989 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffac62-44f8-43e9-bb9e-0f80106aded5 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.434906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.435601 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.435887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.436168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.436928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.438797 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.453486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1409/2773] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:23:58.459610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.471166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8dd6b-84c9-40cc-9f89-2082589e0bb7 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.478194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894fe5d-3219-4e78-925f-1d314cb987da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.478981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fe5d-3219-4e78-925f-1d314cb987da admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.479353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fe5d-3219-4e78-925f-1d314cb987da admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.479700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894fe5d-3219-4e78-925f-1d314cb987da admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.480519 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fe5d-3219-4e78-925f-1d314cb987da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.483033 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894fe5d-3219-4e78-925f-1d314cb987da admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.498329 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1365/2774] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:23:58.502457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.516805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c746c9-a7ec-49eb-b099-63879a8ded5d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.522281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.524863 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.525260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.525629 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] PATH_INFO: `/v3/projects/f0b9afff0cd24da99681ef43e5e6ee64/users/c967b29189fe4062a5b84c6cf4d1c86f/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.546154 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b9afff0cd24da99681ef43e5e6ee64, user_id=c967b29189fe4062a5b84c6cf4d1c86f, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.548909 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.567744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1410/2775] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:23:58 2022] PUT /identity/v3/projects/f0b9afff0cd24da99681ef43e5e6ee64/users/c967b29189fe4062a5b84c6cf4d1c86f/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:23:58.578734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417f128-434e-4e25-aaf6-89ac021f48bd None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.579052 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417f128-434e-4e25-aaf6-89ac021f48bd None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.579298 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417f128-434e-4e25-aaf6-89ac021f48bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.618099 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-5417f128-434e-4e25-aaf6-89ac021f48bd None None] MFA Rules not processed for user `c967b29189fe4062a5b84c6cf4d1c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:23:58.619583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5417f128-434e-4e25-aaf6-89ac021f48bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:58.702914 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1366/2776] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:23:58.718478 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:23:58.720311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:23:58.762086 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:23:58.826710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bea24-d273-4698-8b44-720be11c412e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:23:58.830772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:23:58.831549 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:23:58.831839 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:23:58.832114 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:23:58.841600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:23:58.843060 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:23:58.853451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1411/2777] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:23:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:02.195857 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:02.196466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:02.196613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:02.217695 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] MFA Rules not processed for user `0df0a42b2f2442e2a34b6538311212aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:02.219012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:02.281133 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1367/2778] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:06.753212 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:06.755642 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:06.834776 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8454493-b53e-4169-8a9a-2193f46bc40e service cinder] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:06.840828 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:06.841531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:06.841817 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:06.842095 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:06.844119 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:06.856774 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:06.858412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04423a8c-96c5-46c9-80f3-f5e9f82f2fe8 service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:06.869757 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1412/2779] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:07.119469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:07.121858 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:07.200371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a27587-5601-448e-a1ce-dc92326e1a44 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:07.206208 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:07.207124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:07.207409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:07.207694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] PATH_INFO: `/v3/users/f58fec82ee1b451a87d034508cd71216` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:07.209023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58fec82ee1b451a87d034508cd71216)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:07.211029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:07.251305 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:07.277041 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58fec82ee1b451a87d034508cd71216'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:07.285667 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58fec82ee1b451a87d034508cd71216'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:07.294872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58fec82ee1b451a87d034508cd71216'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:07.295612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58fec82ee1b451a87d034508cd71216'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:07.309888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58fec82ee1b451a87d034508cd71216'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:07.316578 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1368/2780] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:07 2022] DELETE /identity/v3/users/f58fec82ee1b451a87d034508cd71216 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:07.321594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee86b51-8923-4fdc-b83c-ca325f17c379 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:07.322043 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee86b51-8923-4fdc-b83c-ca325f17c379 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:07.322187 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee86b51-8923-4fdc-b83c-ca325f17c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:07.340807 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-0ee86b51-8923-4fdc-b83c-ca325f17c379 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:07.342072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0ee86b51-8923-4fdc-b83c-ca325f17c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:07.405202 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1413/2781] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:07.417760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:07.419300 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:07.501778 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eab6ef-983e-4ede-95fa-0223328d211b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:07.506321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:07.506992 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:07.507301 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:07.507579 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:07.522055 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:07.524632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:07.546964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1369/2782] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:07.850905 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:07.851663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:07.851663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:07.875024 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:07.876286 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:07.987350 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1414/2783] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jun 15 22:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:08.007042 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.008484 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:08.042461 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.045612 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:08.086147 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e08e93-48f2-4546-ba45-7113ab09789d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.105339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.108480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.110123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.110592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] PATH_INFO: `/v3/projects/9b3d03649bec48d2a252e8024bb367ec` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.116002 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3d03649bec48d2a252e8024bb367ec)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.118322 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.130762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:08.131492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6710ac-3f42-4d54-8da9-6e084bfb104e service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.139792 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d485c6a-8a4a-4a96-bbe5-c29189678c90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.140471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d485c6a-8a4a-4a96-bbe5-c29189678c90 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.140754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d485c6a-8a4a-4a96-bbe5-c29189678c90 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.141029 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d485c6a-8a4a-4a96-bbe5-c29189678c90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.151048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d485c6a-8a4a-4a96-bbe5-c29189678c90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.152676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d485c6a-8a4a-4a96-bbe5-c29189678c90 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.162737 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1370/2784] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 22:24:08.192022 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3d03649bec48d2a252e8024bb367ec', 'request_id': 'req-d9d2204f-fce9-4bd0-a173-3736aa27edd4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:08.200591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3d03649bec48d2a252e8024bb367ec', 'request_id': 'req-d9d2204f-fce9-4bd0-a173-3736aa27edd4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:08.209779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3d03649bec48d2a252e8024bb367ec', 'request_id': 'req-d9d2204f-fce9-4bd0-a173-3736aa27edd4'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:08.237211 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] The token cache is being invalidate because project 9b3d03649bec48d2a252e8024bb367ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:08.237811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:08.239027 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-d9d2204f-fce9-4bd0-a173-3736aa27edd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:08.242028 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1415/2785] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:08 2022] DELETE /identity/v3/projects/9b3d03649bec48d2a252e8024bb367ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:08.248713 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.249006 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.249288 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.272879 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:08.274623 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:08.334093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:08.408511 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1371/2786] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:08.416699 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.417065 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.417606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.462657 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:08.463928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:08.490768 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1416/2787] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:08.495266 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.560016 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb636bd-aed5-4d24-b102-640dfd968093 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.570854 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.571557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.571839 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.572112 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.573093 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:24:08.573446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.588911 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.621473 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1372/2788] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:24:08.626368 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.652508 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bcd26b-1efa-4e7e-acf9-6e24c9217411 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.658546 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.659281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.659737 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.659973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.660831 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.663386 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.717423 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1417/2789] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:08 2022] POST /identity/v3/projects => generated 389 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:08.720126 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.737612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab0a7-8daf-455d-9274-0a2d4f98d8f3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.838515 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.842074 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.842388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.842968 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.844195 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.848048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.889735 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.891100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1373/2790] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:08 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:08.903885 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e6a8-7135-40ad-894b-6c214458f59d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.912740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.914656 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.915295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.916293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.917609 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.920288 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.955881 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1418/2791] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:08.957163 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:08.970026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d15b-e76e-4afa-b0ba-e6afa81b5c12 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:08.975238 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0604d77-bd64-4b83-9def-5823b12498a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:08.975978 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0604d77-bd64-4b83-9def-5823b12498a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:08.976218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0604d77-bd64-4b83-9def-5823b12498a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:08.976647 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0604d77-bd64-4b83-9def-5823b12498a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:08.977249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0604d77-bd64-4b83-9def-5823b12498a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:08.978920 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0604d77-bd64-4b83-9def-5823b12498a7 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:08.990610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1374/2792] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:08.995165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:09.023678 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2a828-eb35-4c0e-a558-777a5791796e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:09.039227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:09.042639 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:09.045455 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:09.046222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] PATH_INFO: `/v3/projects/9ec6efae6609421aa91e14ff2ca9c16c/users/a58cb278522d426dbb210eed0afb37ca/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:09.084649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec6efae6609421aa91e14ff2ca9c16c, user_id=a58cb278522d426dbb210eed0afb37ca, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:09.094570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:09.133990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1419/2793] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:08 2022] PUT /identity/v3/projects/9ec6efae6609421aa91e14ff2ca9c16c/users/a58cb278522d426dbb210eed0afb37ca/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:09.145119 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:09.146211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:09.146211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:09.205071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] MFA Rules not processed for user `a58cb278522d426dbb210eed0afb37ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:09.207203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:09.355984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1375/2794] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:09.363361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:09.368654 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:09.476026 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d81b27-bcee-4052-97aa-501058276674 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:09.482227 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832853-d50d-4cf3-a3f3-cb3913e66fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:09.483649 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832853-d50d-4cf3-a3f3-cb3913e66fab service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:09.484210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832853-d50d-4cf3-a3f3-cb3913e66fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:09.486215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832853-d50d-4cf3-a3f3-cb3913e66fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:09.503200 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc832853-d50d-4cf3-a3f3-cb3913e66fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:09.504912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc832853-d50d-4cf3-a3f3-cb3913e66fab service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:09.522457 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1420/2795] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:19.345237 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:19.515251 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:25.646340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:25.648522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:25.748173 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf342-2c20-44fd-9440-d4d413d44d1d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:25.754514 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:25.755409 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:25.755885 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:25.756022 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] PATH_INFO: `/v3/users/c967b29189fe4062a5b84c6cf4d1c86f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:25.757259 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c967b29189fe4062a5b84c6cf4d1c86f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:25.759272 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:25.812354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c967b29189fe4062a5b84c6cf4d1c86f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:25.823584 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c967b29189fe4062a5b84c6cf4d1c86f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:25.831269 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c967b29189fe4062a5b84c6cf4d1c86f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:25.832960 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c967b29189fe4062a5b84c6cf4d1c86f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:25.846487 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c967b29189fe4062a5b84c6cf4d1c86f'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:25.853768 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1376/2796] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:25 2022] DELETE /identity/v3/users/c967b29189fe4062a5b84c6cf4d1c86f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:25.858308 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:25.858794 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:25.859168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:25.877505 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:25.878706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:25.948117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1421/2797] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:25.958640 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:25.960151 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:26.036358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56cce3-0fad-4b07-903f-124ced72d760 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.040782 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daef7e3-2940-463f-b2e4-7ebbc44e1ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.041492 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daef7e3-2940-463f-b2e4-7ebbc44e1ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.041776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daef7e3-2940-463f-b2e4-7ebbc44e1ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.042203 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daef7e3-2940-463f-b2e4-7ebbc44e1ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.053849 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daef7e3-2940-463f-b2e4-7ebbc44e1ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.056152 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daef7e3-2940-463f-b2e4-7ebbc44e1ad1 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.068043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1377/2798] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:26.355734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.357222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:26.370213 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ca76b-625f-4059-97e0-5c74ce7119ab None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.375265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.376149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.376431 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.376706 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] PATH_INFO: `/v3/projects/f0b9afff0cd24da99681ef43e5e6ee64` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.377980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b9afff0cd24da99681ef43e5e6ee64)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.379879 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.430443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b9afff0cd24da99681ef43e5e6ee64', 'request_id': 'req-afb72dd8-d892-4cea-8956-4c762d20e647'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:26.436399 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b9afff0cd24da99681ef43e5e6ee64', 'request_id': 'req-afb72dd8-d892-4cea-8956-4c762d20e647'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:26.443838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b9afff0cd24da99681ef43e5e6ee64', 'request_id': 'req-afb72dd8-d892-4cea-8956-4c762d20e647'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:26.461248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] The token cache is being invalidate because project f0b9afff0cd24da99681ef43e5e6ee64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:26.461704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:26.462590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-afb72dd8-d892-4cea-8956-4c762d20e647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:26.465206 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1422/2799] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:26 2022] DELETE /identity/v3/projects/f0b9afff0cd24da99681ef43e5e6ee64 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:26.470434 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65caed-761f-4559-b494-63234f1e187f None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.470750 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65caed-761f-4559-b494-63234f1e187f None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.471030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65caed-761f-4559-b494-63234f1e187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.490506 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-3d65caed-761f-4559-b494-63234f1e187f None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:26.491815 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3d65caed-761f-4559-b494-63234f1e187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:26.512178 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:26.583945 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1378/2800] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:26.597918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.598748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.599396 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.623378 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:26.624715 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:26.634487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1423/2801] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:26.639612 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65caed-761f-4559-b494-63234f1e187f None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.655254 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65caed-761f-4559-b494-63234f1e187f None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.663821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.664793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.665159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.665563 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.666645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:24:26.667053 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.669616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.687255 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1379/2802] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 22:24:26.694589 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.704927 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa3387-2c81-44a5-a4fa-5db1b6025a5e None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.712530 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.713243 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.713531 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.713838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.714524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.716738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.750277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1424/2803] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:26 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:26.755196 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.767039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861c167-07b3-4aec-b2b4-8e6550614e2d admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.835251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.835953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.836232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.836509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.837233 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.839197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.866388 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1380/2804] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:26 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:26.867708 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.878740 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43513e6-b5c9-4d62-904d-24ab836e754e admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.884135 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.884821 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.885106 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.885411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.886155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.887767 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.899803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1425/2805] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:26.904471 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.915816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c60749-c114-4dc4-bed2-85c62beb7562 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.921822 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd8515-7bfa-4d4c-91cb-efa9dcdffbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.922517 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd8515-7bfa-4d4c-91cb-efa9dcdffbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.922814 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd8515-7bfa-4d4c-91cb-efa9dcdffbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.923068 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd8515-7bfa-4d4c-91cb-efa9dcdffbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.923810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd8515-7bfa-4d4c-91cb-efa9dcdffbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.925446 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd8515-7bfa-4d4c-91cb-efa9dcdffbc2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:26.936731 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1381/2806] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:24:26.945381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:26.957480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e2447-aea5-41e9-8964-0e4d07bf2347 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:26.964298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:26.965197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:26.965524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:26.965805 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] PATH_INFO: `/v3/projects/7e186c1ceb7b426f97957d589f003650/users/159977d0c98d4e7a88f9d8ffe3a9ccdd/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:26.982786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e186c1ceb7b426f97957d589f003650, user_id=159977d0c98d4e7a88f9d8ffe3a9ccdd, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:26.985475 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.003571 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1426/2807] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:26 2022] PUT /identity/v3/projects/7e186c1ceb7b426f97957d589f003650/users/159977d0c98d4e7a88f9d8ffe3a9ccdd/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:27.014956 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.015247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.015528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.044761 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] MFA Rules not processed for user `159977d0c98d4e7a88f9d8ffe3a9ccdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:27.046023 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:27.133974 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1382/2808] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:24:27.139638 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.165452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:27.219298 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da7baa5-e917-4774-a4ca-2561291c9934 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.224730 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.225498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.225793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.226078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.226786 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.228754 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.256011 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1427/2809] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:27 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:27.260241 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.272097 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28b9c-1867-4962-8bba-a6286eb99d35 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.286852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:27.334251 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.335132 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.335567 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.336098 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.336645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.338657 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.359212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1383/2810] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:27 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:27.364964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.380016 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cf714-4c99-427a-81ca-4b91f24be1a0 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.388343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.389500 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.390103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.390674 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.392111 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.395131 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.413799 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1428/2811] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:24:27.419787 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.435722 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe68fd-c711-4f23-aeaf-59ddf4332801 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.443307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03084a-18d9-47a0-9108-b33693f23d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.444030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03084a-18d9-47a0-9108-b33693f23d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.444714 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03084a-18d9-47a0-9108-b33693f23d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.445013 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03084a-18d9-47a0-9108-b33693f23d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.445793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03084a-18d9-47a0-9108-b33693f23d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.447424 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03084a-18d9-47a0-9108-b33693f23d2d admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.465367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1384/2812] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:24:27.469987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.482313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d4e5-e446-49fe-8545-496d05b577b9 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.487261 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.488222 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.488492 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.488770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] PATH_INFO: `/v3/projects/7ff939b0e0bc4a58a32e39d4aa9efbf3/users/0ec757eb8bab4b11a3f5c9172675f871/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.504742 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff939b0e0bc4a58a32e39d4aa9efbf3, user_id=0ec757eb8bab4b11a3f5c9172675f871, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.507972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.522118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1429/2813] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:27 2022] PUT /identity/v3/projects/7ff939b0e0bc4a58a32e39d4aa9efbf3/users/0ec757eb8bab4b11a3f5c9172675f871/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:27.532754 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.533048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.533353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.562261 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] MFA Rules not processed for user `0ec757eb8bab4b11a3f5c9172675f871`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:27.563572 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:27.640368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1385/2814] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:27.644921 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.713181 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21589d-82ad-49bf-967f-6071cabdfa02 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.718156 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.718832 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.719123 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.719405 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.720103 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.722329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.750891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1430/2815] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:27 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:27.755212 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.768775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7f11-caf9-40e4-9e85-32ef1508a91d None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.829692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.830363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.830779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.831062 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.831763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.833752 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.854995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1386/2816] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:27 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:24:27.859242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.870373 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe859b-4e03-42b7-95bf-ce58b6e652ca admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.876526 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.877214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.877540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.877819 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.878539 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.880161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.895219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1431/2817] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:24:27.902853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.912730 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cb1e7-9d77-4046-9737-42415577f4e2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:27.917676 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:27.918571 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:27.918836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:27.919081 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] PATH_INFO: `/v3/projects/1b922045bf144a26b40e34095eebf717/users/2d254266379041f8b7aabae73f03bedb/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:27.931830 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:27.935533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b922045bf144a26b40e34095eebf717, user_id=2d254266379041f8b7aabae73f03bedb, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:27.938590 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:27.954587 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1387/2818] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:27 2022] PUT /identity/v3/projects/1b922045bf144a26b40e34095eebf717/users/2d254266379041f8b7aabae73f03bedb/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:27.958871 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:27.969276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987fc45-c050-48ae-b048-cfc3ce47e863 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:28.013972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:28.033688 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa79fa-0309-41eb-aaf7-8fd079c11623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:28.034380 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa79fa-0309-41eb-aaf7-8fd079c11623 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:28.034720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa79fa-0309-41eb-aaf7-8fd079c11623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:28.035003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa79fa-0309-41eb-aaf7-8fd079c11623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:28.035760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa79fa-0309-41eb-aaf7-8fd079c11623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:28.037463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa79fa-0309-41eb-aaf7-8fd079c11623 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:28.051050 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1432/2819] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:28.052262 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:28.062969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc6c6-89d8-48eb-8e2e-145d9db57fbf admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:28.067861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:28.068729 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:28.069014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:28.069429 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] PATH_INFO: `/v3/projects/1b922045bf144a26b40e34095eebf717/users/2d254266379041f8b7aabae73f03bedb/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:28.071790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b922045bf144a26b40e34095eebf717, user_id=2d254266379041f8b7aabae73f03bedb, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:28.074813 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:28.085681 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1388/2820] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:28 2022] PUT /identity/v3/projects/1b922045bf144a26b40e34095eebf717/users/2d254266379041f8b7aabae73f03bedb/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:28.096293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:28.096822 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:28.097303 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:28.127438 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] MFA Rules not processed for user `2d254266379041f8b7aabae73f03bedb`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:28.128665 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:28.208328 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1433/2821] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:28.219789 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:28.221816 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:28.293632 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab74421-9945-477e-973f-77f89bafad88 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:28.298002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:28.298851 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:28.299014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:28.299295 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:28.364321 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:28.365819 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:28.375504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1389/2822] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:29.936168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:29.947934 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ad312-1f12-489c-8802-9aaa96f5e489 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:29.951731 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4458b-25ab-4028-801a-1f8668ebe01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:29.952412 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4458b-25ab-4028-801a-1f8668ebe01c service cinder] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:29.952896 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4458b-25ab-4028-801a-1f8668ebe01c service cinder] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:29.953339 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4458b-25ab-4028-801a-1f8668ebe01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:30.015401 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4458b-25ab-4028-801a-1f8668ebe01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:30.017306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4458b-25ab-4028-801a-1f8668ebe01c service cinder] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:30.030003 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1434/2823] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:30.500901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:30.502573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:30.584292 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd171b3-c189-4cd9-af20-3ca3aea314fc service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:30.590043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:30.591116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:30.591392 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:30.591843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] PATH_INFO: `/v3/users/a58cb278522d426dbb210eed0afb37ca` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:30.593187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58cb278522d426dbb210eed0afb37ca)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:30.595139 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:30.642021 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:30.654351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58cb278522d426dbb210eed0afb37ca'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:30.662962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58cb278522d426dbb210eed0afb37ca'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:30.671924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58cb278522d426dbb210eed0afb37ca'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:30.672597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58cb278522d426dbb210eed0afb37ca'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:30.688202 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58cb278522d426dbb210eed0afb37ca'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:30.694649 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1390/2824] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:30 2022] DELETE /identity/v3/users/a58cb278522d426dbb210eed0afb37ca => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:30.699856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:30.700507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:30.700795 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:30.716573 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:30.718049 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:30.719436 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:30.720615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:30.777668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8315c71-035a-4685-a13c-bc5f5c692030 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:30.781149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1435/2825] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:30.781495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:30.782162 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:30.782441 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:30.782711 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:30.784859 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:30.791745 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:30.793233 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:30.799687 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=100 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:30.853735 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:30.855294 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:30.856717 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3149db-a0de-4a8a-8321-bb389dd35330 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:30.860949 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:30.861673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:30.862053 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:30.862429 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:30.866363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1391/2826] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:24:30.872340 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:30.873726 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:30.883829 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1436/2827] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:24:31.180744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:31.182613 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:31.201164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f46dc-7803-45f3-b51c-59ff396b5edf service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:31.211270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:31.211871 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:31.212317 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:31.212554 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] PATH_INFO: `/v3/projects/9ec6efae6609421aa91e14ff2ca9c16c` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:31.214002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec6efae6609421aa91e14ff2ca9c16c)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:31.216953 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:31.274131 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec6efae6609421aa91e14ff2ca9c16c', 'request_id': 'req-e0ee809a-5dd7-4965-8484-65cfb31c2a65'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:31.282086 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec6efae6609421aa91e14ff2ca9c16c', 'request_id': 'req-e0ee809a-5dd7-4965-8484-65cfb31c2a65'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:31.283637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:31.292164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec6efae6609421aa91e14ff2ca9c16c', 'request_id': 'req-e0ee809a-5dd7-4965-8484-65cfb31c2a65'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:31.303784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] The token cache is being invalidate because project 9ec6efae6609421aa91e14ff2ca9c16c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:31.304328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:31.305048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-e0ee809a-5dd7-4965-8484-65cfb31c2a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:31.306938 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1392/2828] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:31 2022] DELETE /identity/v3/projects/9ec6efae6609421aa91e14ff2ca9c16c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:34.852282 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:34.854482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:34.874196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd817-0a37-4409-86cb-93cf041214a0 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:34.936570 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:34.937591 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:34.937870 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:34.938153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] PATH_INFO: `/v3/users/159977d0c98d4e7a88f9d8ffe3a9ccdd` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:34.939379 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=159977d0c98d4e7a88f9d8ffe3a9ccdd)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:34.941344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:35.002312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159977d0c98d4e7a88f9d8ffe3a9ccdd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.013520 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159977d0c98d4e7a88f9d8ffe3a9ccdd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.014724 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159977d0c98d4e7a88f9d8ffe3a9ccdd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.039280 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159977d0c98d4e7a88f9d8ffe3a9ccdd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.048452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159977d0c98d4e7a88f9d8ffe3a9ccdd'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.055746 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1437/2829] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:34 2022] DELETE /identity/v3/users/159977d0c98d4e7a88f9d8ffe3a9ccdd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:35.061594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:35.062089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:35.062187 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:35.081674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:35.082890 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:35.153466 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1393/2830] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:35.164341 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:35.166263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:35.206913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:35.241599 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41514585-7eaa-4410-b3cd-703115ece65d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:35.246376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:35.247047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:35.247331 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:35.247637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:35.257883 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:35.259536 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:35.269387 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1438/2831] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 22:24:35.569371 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:35.571189 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:35.583922 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52440b2a-1ae8-45f3-958a-1570b0f0aaf4 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:35.590070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:35.591145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:35.591408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:35.591692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] PATH_INFO: `/v3/projects/7e186c1ceb7b426f97957d589f003650` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:35.593026 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e186c1ceb7b426f97957d589f003650)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:35.594977 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:35.655600 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e186c1ceb7b426f97957d589f003650', 'request_id': 'req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.664518 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e186c1ceb7b426f97957d589f003650', 'request_id': 'req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.671197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e186c1ceb7b426f97957d589f003650', 'request_id': 'req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.681899 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] The token cache is being invalidate because project 7e186c1ceb7b426f97957d589f003650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:35.682185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.682837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.684414 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1394/2832] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:35 2022] DELETE /identity/v3/projects/7e186c1ceb7b426f97957d589f003650 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:35.688581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:35.699580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb937-d6f0-4c24-abee-3d8e3d1a3131 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:35.760586 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:35.761675 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:35.762063 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:35.762451 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] PATH_INFO: `/v3/users/0ec757eb8bab4b11a3f5c9172675f871` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:35.764452 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec757eb8bab4b11a3f5c9172675f871)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:35.767502 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:35.823914 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec757eb8bab4b11a3f5c9172675f871'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.833304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec757eb8bab4b11a3f5c9172675f871'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.834195 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec757eb8bab4b11a3f5c9172675f871'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.847344 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec757eb8bab4b11a3f5c9172675f871'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.855789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec757eb8bab4b11a3f5c9172675f871'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:35.862374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1439/2833] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:35 2022] DELETE /identity/v3/users/0ec757eb8bab4b11a3f5c9172675f871 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:36.170903 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:36.173776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:36.189476 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf0b9c-83e5-488c-9032-ebf05cf8cfcf admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:36.256113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:36.256969 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:36.257249 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:36.257659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] PATH_INFO: `/v3/projects/7ff939b0e0bc4a58a32e39d4aa9efbf3` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:36.259121 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff939b0e0bc4a58a32e39d4aa9efbf3)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:36.261756 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:36.272558 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:36.313802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff939b0e0bc4a58a32e39d4aa9efbf3', 'request_id': 'req-686b0b9c-5414-4674-9c40-041cec10d0f3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.322901 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff939b0e0bc4a58a32e39d4aa9efbf3', 'request_id': 'req-686b0b9c-5414-4674-9c40-041cec10d0f3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.330535 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff939b0e0bc4a58a32e39d4aa9efbf3', 'request_id': 'req-686b0b9c-5414-4674-9c40-041cec10d0f3'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.344410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] The token cache is being invalidate because project 7ff939b0e0bc4a58a32e39d4aa9efbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:36.344701 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.345356 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.346954 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1395/2834] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:36 2022] DELETE /identity/v3/projects/7ff939b0e0bc4a58a32e39d4aa9efbf3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:36.351224 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:36.353400 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:36.371102 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f629a-1357-4c39-aa03-80384f0f99ca admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:36.423788 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:36.437960 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:36.438785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:36.439078 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:36.439364 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] PATH_INFO: `/v3/users/2d254266379041f8b7aabae73f03bedb` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:36.440712 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d254266379041f8b7aabae73f03bedb)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:36.442886 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:36.496974 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d254266379041f8b7aabae73f03bedb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.504727 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d254266379041f8b7aabae73f03bedb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.505462 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d254266379041f8b7aabae73f03bedb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.518047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d254266379041f8b7aabae73f03bedb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.525780 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-1e153e9e-8336-4abe-b6f2-0b679e46ab0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d254266379041f8b7aabae73f03bedb'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.532115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1440/2835] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:36 2022] DELETE /identity/v3/users/2d254266379041f8b7aabae73f03bedb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:36.824724 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:36.826461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:36.845368 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b0b9c-5414-4674-9c40-041cec10d0f3 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:36.911239 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:36.912103 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:36.912389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:36.912677 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] PATH_INFO: `/v3/projects/1b922045bf144a26b40e34095eebf717` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:36.913889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b922045bf144a26b40e34095eebf717)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:36.915880 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:36.964894 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b922045bf144a26b40e34095eebf717', 'request_id': 'req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.975855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b922045bf144a26b40e34095eebf717', 'request_id': 'req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:36.987685 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b922045bf144a26b40e34095eebf717', 'request_id': 'req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:37.001024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] The token cache is being invalidate because project 1b922045bf144a26b40e34095eebf717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:37.001264 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:37.001995 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-b8e2e2d4-4ff0-4666-826c-5f2ec46e2e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:37.003550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1396/2836] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:36 2022] DELETE /identity/v3/projects/1b922045bf144a26b40e34095eebf717 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:37.010275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.010787 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.010912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.031370 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:37.032594 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:37.105127 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1441/2837] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:37.113460 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.113749 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.114030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.134167 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:37.135477 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:37.143702 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1397/2838] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:24:37.148263 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.158901 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fb083-5337-47f1-88f6-93a811db40aa None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.164393 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.165538 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.165931 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.166215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.166999 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:24:37.167315 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.168950 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.182054 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1442/2839] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:24:37.186528 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.196094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3d9d-72a9-4f7e-8d12-4f8b1b5b126a None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.201828 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.202499 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.202926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.203207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.203924 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.206124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.237504 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:37.246069 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1398/2840] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:37 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:24:37.251281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.264566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c9d5-0d00-4a67-b497-3c4ce455ba0c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.321260 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:37.330277 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.331048 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.331408 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.331698 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] PATH_INFO: `/v3/users` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.332415 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.334840 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.357443 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1443/2841] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:37 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:37.361821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.373200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68972046-c9f9-44b9-be7b-40e727931f3b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.378727 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.379410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.379692 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.379955 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.380700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.382349 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.393642 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1399/2842] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:37.397851 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.409845 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aae2a-ef0c-420e-89ac-24ac1384a5af admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.415089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d73855-8493-4984-b8d4-98b9b99995a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.415765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d73855-8493-4984-b8d4-98b9b99995a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.416047 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d73855-8493-4984-b8d4-98b9b99995a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.416314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d73855-8493-4984-b8d4-98b9b99995a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.417090 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d73855-8493-4984-b8d4-98b9b99995a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.418781 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d73855-8493-4984-b8d4-98b9b99995a3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.431762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1444/2843] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:37.436201 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.447085 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b1fd-0b27-4f68-91c2-e4d8357f842f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.453533 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.454448 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.454726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.455028 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] PATH_INFO: `/v3/projects/fc30a31cfdb5492ab2253be3edd1f287/users/f060ac43b582403dba08798087934176/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.472817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc30a31cfdb5492ab2253be3edd1f287, user_id=f060ac43b582403dba08798087934176, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.475491 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.491983 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1400/2844] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:37 2022] PUT /identity/v3/projects/fc30a31cfdb5492ab2253be3edd1f287/users/f060ac43b582403dba08798087934176/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:37.502857 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.503151 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.503620 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.532312 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] MFA Rules not processed for user `f060ac43b582403dba08798087934176`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:37.533607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:37.605158 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1445/2845] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:37.616631 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:37.618694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:37.687315 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d2b4-7631-4049-9aa9-87ce90394da2 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:37.691779 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cfb11b9f0e4b0eb5078ab7a14948ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:37.692412 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:37.692694 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:37.692967 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:37.702328 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:37.703766 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:37.713997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1401/2846] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:40.153880 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:40.155514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:40.219920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e949cf-9997-470c-bdb8-2dbb88b88cb0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:40.227873 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:40.228562 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:40.228843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:40.229115 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:40.234720 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:40.300480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:40.301998 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a3a84-e3f4-447a-b3c9-3b65d1bacf17 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:40.312240 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1446/2847] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:40.318921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:40.387704 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc9513-9102-46ba-a039-71c0f62bbdad service cinder] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:40.393018 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:40.393963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:40.394247 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:40.394524 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] PATH_INFO: `/v3/users/f060ac43b582403dba08798087934176` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:40.395784 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f060ac43b582403dba08798087934176)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:40.397837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:40.450604 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f060ac43b582403dba08798087934176'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:40.459893 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f060ac43b582403dba08798087934176'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:40.469707 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f060ac43b582403dba08798087934176'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:40.470480 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f060ac43b582403dba08798087934176'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:40.476423 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:40.485344 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f060ac43b582403dba08798087934176'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:40.493351 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1402/2848] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:24:40 2022] DELETE /identity/v3/users/f060ac43b582403dba08798087934176 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:40.498297 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:40.498673 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:40.499015 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:40.517600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:40.519081 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:40.529055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:40.584853 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1447/2849] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:24:40.595307 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:40.597000 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:40.656108 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0039e-8f35-4e31-9b8f-92cbe30d039f admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:40.659852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e93f84-e324-40f0-875b-745eabd4a702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:40.660529 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93f84-e324-40f0-875b-745eabd4a702 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:40.660812 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93f84-e324-40f0-875b-745eabd4a702 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:40.661084 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e93f84-e324-40f0-875b-745eabd4a702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:40.671267 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e93f84-e324-40f0-875b-745eabd4a702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:40.672739 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e93f84-e324-40f0-875b-745eabd4a702 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:40.682973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1403/2850] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:40.960607 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:40.962349 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:40.987361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d1381-65dd-42d4-917b-21f2f3d60203 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:40.994105 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:40.995044 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:40.995329 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:40.995614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] PATH_INFO: `/v3/projects/fc30a31cfdb5492ab2253be3edd1f287` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:40.997760 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc30a31cfdb5492ab2253be3edd1f287)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.000045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.055292 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc30a31cfdb5492ab2253be3edd1f287', 'request_id': 'req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:41.062482 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc30a31cfdb5492ab2253be3edd1f287', 'request_id': 'req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:41.069293 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc30a31cfdb5492ab2253be3edd1f287', 'request_id': 'req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:41.083459 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] The token cache is being invalidate because project fc30a31cfdb5492ab2253be3edd1f287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:24:41.083752 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:41.084381 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-f46901ac-dc1f-4d59-bc3e-f7fae4cd2cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:24:41.085987 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1448/2851] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:24:40 2022] DELETE /identity/v3/projects/fc30a31cfdb5492ab2253be3edd1f287 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:41.091154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.091467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.091783 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.110785 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:41.112061 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:41.186050 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1404/2852] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:24:41.197281 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.197892 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.198006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.219600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:41.220833 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:41.234383 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1449/2853] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:41.238963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.249481 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bbfc3-9b46-41e8-bdce-5f76dce3e7e3 None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.254363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.255024 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.255311 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.255637 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.256355 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 22:24:41.256659 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.258297 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.272046 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1405/2854] 10.222.0.55 () {58 vars in 1152 bytes} [Wed Jun 15 22:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 22:24:41.278996 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.288714 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cfc38-c658-4479-b73e-03cea0561640 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.294332 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.295000 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.295304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.295592 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.296270 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.298210 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.327100 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1450/2855] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:41.331674 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.342777 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52863ca-2c45-4aea-946c-f563b99be352 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.405743 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.406439 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.406878 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.407156 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.407861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.409872 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.433110 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1406/2856] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:41 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:41.437395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.448550 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba32c09-96f9-4238-8c4c-4b90f4323b2c admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.454507 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.455324 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.455672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.456018 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.456837 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.458608 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.470789 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1451/2857] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:41.475070 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.486433 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb4e51-430f-43ad-9e57-b870f11af255 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.491327 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244e9eb-dcea-4509-8f24-55987cd3f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.492010 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244e9eb-dcea-4509-8f24-55987cd3f570 admin admin] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.492286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244e9eb-dcea-4509-8f24-55987cd3f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.492562 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244e9eb-dcea-4509-8f24-55987cd3f570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.493281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244e9eb-dcea-4509-8f24-55987cd3f570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.495231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244e9eb-dcea-4509-8f24-55987cd3f570 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.496808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:41.514931 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1407/2858] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 22:24:41.519236 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.531092 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683107bc-fb43-4931-8f57-c2c3458c5194 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.536762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.537734 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.538017 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.538291 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] PATH_INFO: `/v3/projects/b2f3d3513c1440cfb73ba8f3c791c21e/users/c8785472d62341b1bf159153a7296ade/roles/b00b4e9815664c168438c3cc4e734a6f` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.556432 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f3d3513c1440cfb73ba8f3c791c21e, user_id=c8785472d62341b1bf159153a7296ade, role_id=b00b4e9815664c168438c3cc4e734a6f)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.559311 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.579860 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1452/2859] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:41 2022] PUT /identity/v3/projects/b2f3d3513c1440cfb73ba8f3c791c21e/users/c8785472d62341b1bf159153a7296ade/roles/b00b4e9815664c168438c3cc4e734a6f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:41.581898 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c147-167e-4de6-a959-034d409b5451 None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.582191 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c147-167e-4de6-a959-034d409b5451 None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.582509 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6c147-167e-4de6-a959-034d409b5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.602012 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a2b6c147-167e-4de6-a959-034d409b5451 None None] MFA Rules not processed for user `2163e83cb8fa4cdb98d8294e2a7f2e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:41.603285 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a2b6c147-167e-4de6-a959-034d409b5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:41.668275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1408/2860] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:41.678516 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:41.680567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:41.719458 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:41.746928 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232df23-cd88-4696-aaad-d2531b135c8d admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:41.751058 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:41.751728 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:41.752012 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:41.752313 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:41.762541 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:41.764034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:41.774992 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1453/2861] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:24:47.145963 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.146469 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.146575 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.178869 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] MFA Rules not processed for user `c8785472d62341b1bf159153a7296ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:47.180100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:47.264207 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1409/2862] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:47.268082 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:47.281216 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aa29c-0f01-4d1a-a807-02d5c4b99ad6 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:47.286631 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:47.287480 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.287856 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.288256 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.289074 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:47.291957 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:47.323764 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1454/2863] 10.222.0.55 () {60 vars in 1152 bytes} [Wed Jun 15 22:24:47 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 22:24:47.328001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:47.339585 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6f3c-c55d-4c5d-ba2c-b94bac87a5bb None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:47.432211 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:47.433408 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.433900 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.434391 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] PATH_INFO: `/v3/users` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.435712 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:47.439611 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:47.481396 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1410/2864] 10.222.0.55 () {60 vars in 1143 bytes} [Wed Jun 15 22:24:47 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 22:24:47.483140 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:47.500606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe54348-6a8e-4c83-8163-bc210b61f5a7 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:47.505951 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:47.506646 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.506937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.507215 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.507980 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:47.509785 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:47.523163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1455/2865] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:47.530547 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:47.543172 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aff7a-1489-4f2f-af7b-c2a1e1622689 admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:47.549402 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:47.554419 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.554855 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.555014 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] PATH_INFO: `/v3/projects/f792e995b3a64a44ae8cee411b195778/users/846f03d75afa4c3bb285816bc9e5f526/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.571753 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:24:47.575755 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f792e995b3a64a44ae8cee411b195778, user_id=846f03d75afa4c3bb285816bc9e5f526, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:47.580596 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:47.613389 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1411/2866] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:47 2022] PUT /identity/v3/projects/f792e995b3a64a44ae8cee411b195778/users/846f03d75afa4c3bb285816bc9e5f526/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:47.614690 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:47.626369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d34d47-f018-412c-bced-f47e6786f7f3 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:47.699204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f18e-0b16-4647-933a-e929577b3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:47.699930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f18e-0b16-4647-933a-e929577b3dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.700219 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f18e-0b16-4647-933a-e929577b3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.700499 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f18e-0b16-4647-933a-e929577b3dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.701275 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7f18e-0b16-4647-933a-e929577b3dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:47.702902 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7f18e-0b16-4647-933a-e929577b3dc9 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:47.713897 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1456/2867] 10.222.0.55 () {58 vars in 1121 bytes} [Wed Jun 15 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 22:24:47.718367 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:47.729597 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7832df8-a17e-48cd-9977-a4193c18a88e admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:47.734415 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:47.735359 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:47.735645 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:47.735925 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] PATH_INFO: `/v3/projects/f792e995b3a64a44ae8cee411b195778/users/846f03d75afa4c3bb285816bc9e5f526/roles/24c83faa9d6c4e329ea36d0c60d33d34` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:47.737940 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f792e995b3a64a44ae8cee411b195778, user_id=846f03d75afa4c3bb285816bc9e5f526, role_id=24c83faa9d6c4e329ea36d0c60d33d34)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:47.740624 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:47.751617 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1412/2868] 10.222.0.55 () {60 vars in 1482 bytes} [Wed Jun 15 22:24:47 2022] PUT /identity/v3/projects/f792e995b3a64a44ae8cee411b195778/users/846f03d75afa4c3bb285816bc9e5f526/roles/24c83faa9d6c4e329ea36d0c60d33d34 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:24:52.563576 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232748-6d98-493a-b0d1-eaf499a3cb18 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:52.564098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232748-6d98-493a-b0d1-eaf499a3cb18 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:52.564098 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1232748-6d98-493a-b0d1-eaf499a3cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:52.593738 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-d1232748-6d98-493a-b0d1-eaf499a3cb18 None None] MFA Rules not processed for user `846f03d75afa4c3bb285816bc9e5f526`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:24:52.594964 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-d1232748-6d98-493a-b0d1-eaf499a3cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:52.673055 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1457/2869] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:24:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:24:52.687763 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:24:52.689668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:24:52.776117 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906299ea-70fc-4902-a9b9-7620a658bdbc admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:24:52.782105 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:24:52.782808 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:24:52.783116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:24:52.783318 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:24:52.848981 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:24:52.850653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:24:52.859984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1413/2870] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:24:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:25:02.669816 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:02.855653 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:09.324045 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:25:09.324603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:25:09.324603 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:25:09.343306 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] MFA Rules not processed for user `c8785472d62341b1bf159153a7296ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:25:09.344514 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:25:09.352779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1458/2871] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:25:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:25:19.337548 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:32.514096 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:25:32.515598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:25:32.580183 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526949bb-3cbd-4f23-bea1-8d2844ceda39 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:25:32.584633 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:25:32.585290 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:25:32.585592 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:25:32.585881 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:25:32.596149 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:25:32.597626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:25:32.608726 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1414/2872] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:25:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:25:42.603353 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=26 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:44.626792 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:25:44.637572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3178b3-a4cd-4104-a52e-42dcaa871f8c None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:25:44.641487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:25:44.642163 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:25:44.642434 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:25:44.642954 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:25:44.645809 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:25:44.664008 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:25:44.665522 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18365-00ae-4f42-b8ec-97b36ac2752d service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:25:44.676918 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1459/2873] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:25:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:25:45.874538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:25:45.884270 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b91cd-90a2-4402-b2ae-3f5bf19845e1 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:25:45.888877 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:25:45.889580 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:25:45.889840 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:25:45.890109 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:25:45.892223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:25:45.909399 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:25:45.911545 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:25:45.929864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1415/2874] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:25:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:25:54.671983 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=6 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:25:55.921852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:26:07.517748 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:07.518250 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:07.518359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:07.537483 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] MFA Rules not processed for user `fb8c1184414947a8ad358a0eb891ba30`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:26:07.538696 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:07.597784 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1460/2875] 10.222.0.55 () {58 vars in 967 bytes} [Wed Jun 15 22:26:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:26:07.639538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:26:07.641164 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:07.713358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d34ce-9b5a-40e3-9db6-52cbf31f4cc6 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:26:07.718742 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f433e4fc095b4c149082b305ea3c625d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:26:07.719400 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:07.719684 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:07.719959 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:07.728199 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:26:07.729862 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:26:07.738394 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1416/2876] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Jun 15 22:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 22:26:11.353173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:26:11.354952 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:11.454430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56457-48cf-4694-bc6c-8c37f3c56d0d None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:26:11.460611 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:26:11.461606 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:11.461765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:11.462089 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:11.464057 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:11.476615 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:26:11.478346 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:26:11.489467 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1461/2877] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:26:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:26:14.674485 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:26:14.676144 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:14.746101 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a96464-8aa4-4bd5-b1df-a4ede0cac023 service swift] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:26:14.751686 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:26:14.752583 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:14.752864 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:14.753160 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] PATH_INFO: `/v3/users/0df0a42b2f2442e2a34b6538311212aa` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:14.754458 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df0a42b2f2442e2a34b6538311212aa)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:26:14.756420 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:26:14.807496 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df0a42b2f2442e2a34b6538311212aa'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:14.815104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df0a42b2f2442e2a34b6538311212aa'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:14.822184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df0a42b2f2442e2a34b6538311212aa'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:14.822861 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df0a42b2f2442e2a34b6538311212aa'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:14.837185 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df0a42b2f2442e2a34b6538311212aa'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:14.845128 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1417/2878] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:26:14 2022] DELETE /identity/v3/users/0df0a42b2f2442e2a34b6538311212aa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:26:15.036573 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:26:15.048235 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be8d7-499e-4752-a071-22b78f2d5e4a service placement] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:26:15.112917 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:26:15.114039 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:15.114437 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:15.115006 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] PATH_INFO: `/v3/projects/0d141f1b8c984a5a9fbf2fb3c8f01b2b` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:15.116420 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d141f1b8c984a5a9fbf2fb3c8f01b2b)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:26:15.119414 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:26:15.166064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:26:15.177446 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'request_id': 'req-56782562-6bf7-47a8-bd9b-50b3d6aaa477'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.182937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'request_id': 'req-56782562-6bf7-47a8-bd9b-50b3d6aaa477'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.189741 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d141f1b8c984a5a9fbf2fb3c8f01b2b', 'request_id': 'req-56782562-6bf7-47a8-bd9b-50b3d6aaa477'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.205770 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] The token cache is being invalidate because project 0d141f1b8c984a5a9fbf2fb3c8f01b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:26:15.206071 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.206704 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.208672 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1462/2879] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:26:15 2022] DELETE /identity/v3/projects/0d141f1b8c984a5a9fbf2fb3c8f01b2b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:26:15.213218 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:26:15.214776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:15.229200 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335db20a-881d-4697-afc8-74729576cc5b admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:26:15.237626 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:26:15.298106 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:26:15.298998 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:15.299281 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:15.299552 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] PATH_INFO: `/v3/users/4c6bead4b60747729d8ae0de408dbe5d` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:15.300837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6bead4b60747729d8ae0de408dbe5d)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:26:15.302823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:26:15.355001 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6bead4b60747729d8ae0de408dbe5d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.363610 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6bead4b60747729d8ae0de408dbe5d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.370744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6bead4b60747729d8ae0de408dbe5d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.371436 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6bead4b60747729d8ae0de408dbe5d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.383538 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6bead4b60747729d8ae0de408dbe5d'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.389896 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1418/2880] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:26:15 2022] DELETE /identity/v3/users/4c6bead4b60747729d8ae0de408dbe5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:26:15.576572 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:26:15.578165 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:26:15.592859 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56782562-6bf7-47a8-bd9b-50b3d6aaa477 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:26:15.660710 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:26:15.661637 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:26:15.661920 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:26:15.662197 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] PATH_INFO: `/v3/projects/58c17e29e47547019294543be70e1043` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:26:15.663463 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c17e29e47547019294543be70e1043)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:26:15.665435 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:26:15.719132 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c17e29e47547019294543be70e1043', 'request_id': 'req-65d67045-5b6e-4075-a5df-24273cc0f99f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.724490 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c17e29e47547019294543be70e1043', 'request_id': 'req-65d67045-5b6e-4075-a5df-24273cc0f99f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.731149 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c17e29e47547019294543be70e1043', 'request_id': 'req-65d67045-5b6e-4075-a5df-24273cc0f99f'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.747616 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] The token cache is being invalidate because project 58c17e29e47547019294543be70e1043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:26:15.747912 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.748663 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:26:15.750367 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1463/2881] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:26:15 2022] DELETE /identity/v3/projects/58c17e29e47547019294543be70e1043 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:26:25.386354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:26:25.742868 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:08.475378 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:08.477760 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:08.560116 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc51fb-dcb2-46fc-bde4-bf1c775957ec admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:08.644823 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:08.645621 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:08.645964 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:08.647051 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:08.649092 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:08.661561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:08.665184 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:08.676888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1419/2882] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:27:09.746487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:09.748072 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:09.819630 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67045-5b6e-4075-a5df-24273cc0f99f admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:09.823521 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:09.824182 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:09.824465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:09.824744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:09.826567 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:09.837666 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:09.839168 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:09.848614 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1464/2883] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:27:10.988159 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:10.990122 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:11.006335 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c560f-116d-402b-a2fa-c7ee2c021cf9 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:11.012426 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:11.013087 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:11.013398 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:11.013680 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:11.015744 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:11.031314 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:11.032927 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:11.045190 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1420/2884] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:27:18.182155 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:18.183793 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:18.195038 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53a6f-c041-41a4-9a97-fc5dd8bd7d0c service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:18.199729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:18.200684 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:18.200972 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:18.201248 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:18.203488 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:18.275729 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:18.277214 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:18.287064 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1465/2885] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:27:19.147325 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:19.149437 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:19.165990 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb69b-6e41-44fa-a057-6bd42b118073 service nova] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:19.170662 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:19.171561 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:19.171847 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:19.172124 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] PATH_INFO: `/v3/users/fb2ceaafe83f4d67ae9ea6492b21a850` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:19.173354 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2ceaafe83f4d67ae9ea6492b21a850)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:19.175308 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:19.235410 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2ceaafe83f4d67ae9ea6492b21a850'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.243926 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2ceaafe83f4d67ae9ea6492b21a850'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.253616 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2ceaafe83f4d67ae9ea6492b21a850'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.254340 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2ceaafe83f4d67ae9ea6492b21a850'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.256358 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:19.273917 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2ceaafe83f4d67ae9ea6492b21a850'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.280364 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1421/2886] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:27:19 2022] DELETE /identity/v3/users/fb2ceaafe83f4d67ae9ea6492b21a850 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:27:19.471765 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:19.483621 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97287f-586b-41b5-8483-efd7657d4529 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:19.550711 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:19.551498 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:19.551779 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:19.552051 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] PATH_INFO: `/v3/projects/1bc7b00884114a089c6d2c785fc8e9ed` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:19.553290 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc7b00884114a089c6d2c785fc8e9ed)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:19.556128 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:19.601790 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:19.610610 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc7b00884114a089c6d2c785fc8e9ed', 'request_id': 'req-5f343870-f121-4e21-90ff-4de5e5dc5a02'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.616397 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc7b00884114a089c6d2c785fc8e9ed', 'request_id': 'req-5f343870-f121-4e21-90ff-4de5e5dc5a02'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.622978 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc7b00884114a089c6d2c785fc8e9ed', 'request_id': 'req-5f343870-f121-4e21-90ff-4de5e5dc5a02'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.638343 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] The token cache is being invalidate because project 1bc7b00884114a089c6d2c785fc8e9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:27:19.638744 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.639512 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.641985 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1466/2887] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:27:19 2022] DELETE /identity/v3/projects/1bc7b00884114a089c6d2c785fc8e9ed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:27:19.646467 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:19.648104 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:19.662944 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fbea5-c587-407a-84c9-61172fea950a admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:19.729837 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:19.730718 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:19.731008 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:19.731275 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] PATH_INFO: `/v3/users/a2dfe915d4664630ab1d29d6eeee7e3b` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:19.732495 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2dfe915d4664630ab1d29d6eeee7e3b)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:19.734442 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:19.784810 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2dfe915d4664630ab1d29d6eeee7e3b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.793678 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2dfe915d4664630ab1d29d6eeee7e3b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.800929 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2dfe915d4664630ab1d29d6eeee7e3b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.801966 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2dfe915d4664630ab1d29d6eeee7e3b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.818557 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-7e771728-a66b-4d19-b4d0-b21660a19e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2dfe915d4664630ab1d29d6eeee7e3b'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:19.825440 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1422/2888] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:27:19 2022] DELETE /identity/v3/users/a2dfe915d4664630ab1d29d6eeee7e3b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:27:20.006406 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:20.007973 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:20.021823 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343870-f121-4e21-90ff-4de5e5dc5a02 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:20.082374 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:20.083161 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:20.083442 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:20.083721 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] PATH_INFO: `/v3/projects/ecb23bdcedd840e3ac304264db268bb1` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:20.085021 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb23bdcedd840e3ac304264db268bb1)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:20.087025 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:20.136910 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb23bdcedd840e3ac304264db268bb1', 'request_id': 'req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:20.142906 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb23bdcedd840e3ac304264db268bb1', 'request_id': 'req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:20.150842 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb23bdcedd840e3ac304264db268bb1', 'request_id': 'req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:20.168762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] The token cache is being invalidate because project ecb23bdcedd840e3ac304264db268bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80294) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:27:20.169118 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:20.169891 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:27:20.171566 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1467/2889] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:27:20 2022] DELETE /identity/v3/projects/ecb23bdcedd840e3ac304264db268bb1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:27:29.821921 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:30.165465 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:35.906137 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] REQUEST_METHOD: `POST` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:35.906710 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:35.906817 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:35.925790 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.auth.core [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] MFA Rules not processed for user `c8785472d62341b1bf159153a7296ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:27:35.927034 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:35.984094 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1423/2890] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:27:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 22:27:36.321798 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:36.323878 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:36.397848 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8cc93-77fe-4aeb-a5ff-aebab508a3fe admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:36.401930 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:36.402590 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:36.402898 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:36.403173 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:36.405923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:36.415923 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:36.417358 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:36.426139 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1468/2891] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:27:36.937598 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:36.939075 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:37.013775 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe13f1-b006-43e4-a6e9-4e549c7cccca None None] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:37.019286 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:37.019958 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:37.020226 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:37.020843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:37.022852 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:37.035002 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:37.036594 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:37.046888 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1424/2892] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:27:46.422376 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=26 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:47.042765 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=57 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:27:50.752555 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:27:50.754162 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:50.864304 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5742dd-0f53-4fac-9385-6d0b108de752 service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:27:50.869925 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:27:50.870581 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:27:50.870865 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:27:50.871146 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:27:50.872961 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:27:50.899772 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:27:50.901843 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886a308-d79b-40c3-ad5c-6c3801b1bf02 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:27:50.924600 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1469/2893] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:27:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:28:00.920316 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=56 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:36.782776 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:29:36.784745 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:36.877865 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3548f07-3792-4bf7-8557-d8a31194841a service placement] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:29:36.883054 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:29:36.883709 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:29:36.883996 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:29:36.884268 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:29:36.887668 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:36.899961 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:29:36.903170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:29:36.914947 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1425/2894] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:29:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:29:39.313613 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] REQUEST_METHOD: `POST` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:29:39.314190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:29:39.314190 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:29:39.334361 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.auth.core [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] MFA Rules not processed for user `c8785472d62341b1bf159153a7296ade`. Rule list: `[]` (Enabled: `True`). {{(pid=80294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 22:29:39.335578 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:39.344693 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1470/2895] 10.222.0.55 () {58 vars in 957 bytes} [Wed Jun 15 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 22:29:39.720039 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:29:39.721949 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:39.759071 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d34f5a-e900-4156-8920-ee99a44eb656 service placement] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:29:39.763234 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:29:39.763892 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:29:39.764176 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:29:39.764452 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:29:39.766324 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:39.782142 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:29:39.784145 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:29:39.795635 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1426/2896] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:29:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:29:49.328838 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=3 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:49.791030 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=52 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:29:53.165681 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:29:53.167481 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:53.228357 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9427-e38c-40d1-bbb8-e672be20cce0 None None] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:29:53.235887 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37af776e1e594cf092bdcb7cf4e86379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:29:53.237034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:29:53.237034 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:29:53.237242 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:29:53.239295 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:29:53.252283 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:29:53.254104 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:29:53.265826 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1471/2897] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:29:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:30:03.261264 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=18 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:30.483700 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:30.493505 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513a267-8b31-47f7-9f62-7329e6e14e72 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:30.498526 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:30.499181 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:30.499461 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:30.499734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:30.502100 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:30.517829 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:30.519362 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:30.530973 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1427/2898] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:31:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:31:31.979430 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:31.991806 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9627fa-ae08-4ec3-a669-7afb3b550a79 service nova] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:31.996487 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:31.997124 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:31.997440 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:31.997716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:31.999915 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:32.016716 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:32.018299 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:32.030321 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1472/2899] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:31:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:31:40.525650 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=6 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:42.024804 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=6 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:43.023997 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:43.033363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95368b16-5f20-453e-8dfc-6208281c6b70 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:43.037889 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f079c8cd88047f6b563caff1dc5e52a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:43.038550 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:43.038836 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:43.039114 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:43.041170 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:43.130231 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:43.131687 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:43.152223 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1428/2900] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:31:46.342265 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:46.354877 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c7de-e9b7-435d-803b-752266468ecf service neutron] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:46.359580 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:46.360239 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:46.360559 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:46.360937 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:46.364335 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:46.382540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:46.385117 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:46.398318 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1473/2901] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:31:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:31:49.574113 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:49.585833 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c20487-ef0e-40b2-8d27-ce751965f5f7 service neutron] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:49.591043 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:49.592232 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] REQUEST_METHOD: `GET` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:49.592522 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:49.592796 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:49.594605 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:49.610287 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:49.612279 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:49.633528 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:49.635145 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:49.641494 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1429/2902] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:31:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:31:49.662314 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca1644-0df3-4786-9fde-1c5f0ba6c217 service placement] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:49.667827 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:49.668884 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:49.669167 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:49.669486 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] PATH_INFO: `/v3/users/c8785472d62341b1bf159153a7296ade` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:49.670866 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8785472d62341b1bf159153a7296ade)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:49.672895 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:49.724204 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8785472d62341b1bf159153a7296ade'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:49.733532 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8785472d62341b1bf159153a7296ade'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:49.734153 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8785472d62341b1bf159153a7296ade'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:49.746811 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8785472d62341b1bf159153a7296ade'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:49.753709 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8785472d62341b1bf159153a7296ade'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:49.759803 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1474/2903] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:31:49 2022] DELETE /identity/v3/users/c8785472d62341b1bf159153a7296ade => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 22:31:49.943338 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:49.954166 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c469a3-39d0-4e49-8099-ce79bb2f2c30 service placement] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:50.011179 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:50.012045 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:50.012320 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:50.012595 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] PATH_INFO: `/v3/projects/b2f3d3513c1440cfb73ba8f3c791c21e` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:50.013853 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f3d3513c1440cfb73ba8f3c791c21e)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:50.016120 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:50.063793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'request_id': 'req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.067673 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:50.071843 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'request_id': 'req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.079197 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f3d3513c1440cfb73ba8f3c791c21e', 'request_id': 'req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.089908 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] The token cache is being invalidate because project b2f3d3513c1440cfb73ba8f3c791c21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:31:50.090194 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.090821 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.092453 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1430/2904] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:31:49 2022] DELETE /identity/v3/projects/b2f3d3513c1440cfb73ba8f3c791c21e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:31:50.096783 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:50.098411 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:50.112564 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2694bf-7a96-436d-a0d4-5cab005408e2 admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:50.171762 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:50.172671 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:50.172944 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:50.173223 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] PATH_INFO: `/v3/users/846f03d75afa4c3bb285816bc9e5f526` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:50.174524 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] RBAC: Authorizing `identity:delete_user(user_id=846f03d75afa4c3bb285816bc9e5f526)` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:50.176469 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:50.226196 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846f03d75afa4c3bb285816bc9e5f526'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.235276 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846f03d75afa4c3bb285816bc9e5f526'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.235938 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846f03d75afa4c3bb285816bc9e5f526'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.241540 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:31:50.250359 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846f03d75afa4c3bb285816bc9e5f526'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.257588 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.notifications [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846f03d75afa4c3bb285816bc9e5f526'} {{(pid=80294) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.264345 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1475/2905] 10.222.0.55 () {58 vars in 1223 bytes} [Wed Jun 15 22:31:50 2022] DELETE /identity/v3/users/846f03d75afa4c3bb285816bc9e5f526 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:31:50.447793 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Authenticating user token {{(pid=80293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:31:50.449250 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.fernet_utils [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:31:50.462734 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6c08c-dafa-49e8-8c04-e7589f788eeb admin admin] Validating token access rules against request {{(pid=80293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:31:50.524154 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2163e83cb8fa4cdb98d8294e2a7f2e22', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adfb054cdc38413f9503cf43dad1c55e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:31:50.525048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:31:50.525357 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:31:50.525666 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] PATH_INFO: `/v3/projects/f792e995b3a64a44ae8cee411b195778` {{(pid=80293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:31:50.526962 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f792e995b3a64a44ae8cee411b195778)` {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:31:50.528886 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] RBAC: Authorization granted {{(pid=80293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:31:50.587802 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f792e995b3a64a44ae8cee411b195778', 'request_id': 'req-a4312eec-c33f-429e-8df4-ab85b0a76906'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.597080 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f792e995b3a64a44ae8cee411b195778', 'request_id': 'req-a4312eec-c33f-429e-8df4-ab85b0a76906'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.604037 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f792e995b3a64a44ae8cee411b195778', 'request_id': 'req-a4312eec-c33f-429e-8df4-ab85b0a76906'} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.615048 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] The token cache is being invalidate because project f792e995b3a64a44ae8cee411b195778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80293) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 22:31:50.615336 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.615984 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG keystone.notifications [None req-a4312eec-c33f-429e-8df4-ab85b0a76906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80293) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 22:31:50.618089 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: [pid: 80293|app: 0|req: 1431/2906] 10.222.0.55 () {58 vars in 1232 bytes} [Wed Jun 15 22:31:50 2022] DELETE /identity/v3/projects/f792e995b3a64a44ae8cee411b195778 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 22:32:00.260353 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:32:00.612363 dv-cinder-835384-7-iscsi devstack@keystone.service[80293]: DEBUG dbcounter [-] [80293] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 22:34:39.484375 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Authenticating user token {{(pid=80294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 22:34:39.485913 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:34:39.559707 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb28d-12ff-4cba-a372-8762560a96db admin admin] Validating token access rules against request {{(pid=80294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 22:34:39.622990 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f07fe125a6a7414b9f2702cb75bf681e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb3dc60f951d4948b213ce7d5915c292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 22:34:39.623653 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] REQUEST_METHOD: `GET` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 22:34:39.623935 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] SCRIPT_NAME: `/identity` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 22:34:39.624246 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 22:34:39.626369 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.fernet_utils [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 22:34:39.638758 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 22:34:39.640351 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a084-df1a-4cf9-8559-a982d8e95f92 service placement] RBAC: Authorization granted {{(pid=80294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 22:34:39.650395 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: [pid: 80294|app: 0|req: 1476/2907] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jun 15 22:34:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 22:34:49.646426 dv-cinder-835384-7-iscsi devstack@keystone.service[80294]: DEBUG dbcounter [-] [80294] Writing DB stats keystone:SELECT=58 {{(pid=80294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}